Design and Implementation of Parallel Counterpropagation Networks Using MPI

Article type: Research Article

Authors: Margaris, Athanasios | Souravlas, Stavros | Kotsialos, Efthimios | Roumeliotis, Manos

Affiliations: University of Macedonia, Dept. of Applied Informatics, 156 Engatia Str., GR 540-06,Thessaloniki, Greece, e-mail: [email protected], [email protected], [email protected], [email protected]

Abstract: The objective of this research is to construct parallel models that simulate the behavior of artificial neural networks. The type of network that is simulated in this project is the counterpropagation network and the parallel platform used to simulate that network is the message passing interface (MPI). In the next sections the counterpropagation algorithm is presented in its serial as well as its parallel version. For the latter case, simulation results are given for the session parallelization as well as the training set parallelization approach. Regarding possible parallelization of the network structure, there are two different approaches that are presented; one that is based to the concept of the intercommunicator and one that uses remote access operations for the update of the weight tables and the estimation of the mean error for each training stage.

Keywords: neural networks, counterpropagation, parallel programming, message passing interface, communicators, process groups, point to point communications, collective communication, RMA operations

Journal: Informatica, vol. 18, no. 1, pp. 79-102, 2007