Associative ability of higher order correlation models for sequential patterns

Article type: Research Article

Authors: Miyajima, Hiromi^{; *} | Shigei, Noritaka

Affiliations: Department of Electrical and Electronics Engineering, Kagoshima University, 1-21-40 Korimoto, Kagoshima, 890–0065, Japan

Correspondence: [*] Corresponding author. Tel./Fax: +81 99 285 8422; E-mail: [email protected]

Abstract: This paper describes some results on transition properties and the absolute capacities of higher order correlation and differential correlation associative memories. First, it is shown that the absolute capacities are (1−s¯)22(1−s¯2)1−klogN and {2(1−s¯2)k−1}22k+2(1−s¯2)1−klogN for correlation and differential correlation models, respectively, where N is the number of neurons, s¯ is the rate of correlation for patterns and k is the dimension. The results show that the absolute capacities approach to 0 rapidly as N increases in both models and they decrease rapidly in the correlation model and slowly in the differential correlation model as s¯ increases. Further, it is clarified that the correlation model is superior in storage capacities and inferior in robustness than the differential correlation one.

DOI: 10.3233/KES-2006-10601

Journal: International Journal of Knowledge-based and Intelligent Engineering Systems, vol. 10, no. 6, pp. 403-416, 2006