Optimal and Suboptimal Pattern Allocation Schemes for Backpropagation Learning on a Heterogeneous Processor Network

Article type: Research Article

Authors: Foo, Shou King^; | Saratchandran, P. | Sundararajan, N.

Affiliations: School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, e-mail: [email protected]

Note: [] An earlier version of this article was presented at the 3rd International Conference on Automation. Robotics and Computer Vision, Singapore, November 1994.

Abstract: This article investigates optimal and suboptimal pattern allocation schemes when training-set parallelism is used as the paradigm to map a backpropagation neural network on a heterogeneous array of processors. In earlier work, it was shown that finding the optimal allocation of patterns to minimize the time for a training epoch for such a mapping leads to a mixed integer programming problem. Because the solution to the mixed integer programming requires prohibitively large computing time, several suboptimal allocation methods that are computationally less demanding are discussed and their performance compared with the optimal solution for the NETTALK benchmark problem. The processor network used for mapping the neural network is a heterogeneous array of transputers connected in a pipelined ring topology.

DOI: 10.3233/IFS-1996-4305

Journal: Journal of Intelligent and Fuzzy Systems, vol. 4, no. 3, pp. 227-234, 1996