Searching for just a few words should be enough to get started. If you need to make more complex queries, use the tips below to guide you.
Article type: Research Article
Authors: Cho, Young-Bin | Gweon, Dae-Gab;
Affiliations: Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 373-1 Kusung-Dong, Yusung-Gu, Taejon, 305-701, Korea
Note: [] Corresponding author. Tel.: +82 42 869 3265; Fax: +82 42 869 5225; E-mail: [email protected].
Abstract: Aritificial neural networks may be used for a function approximator which includes not only deterministic but also probabilistic model. Conditional variance estimation using a neural network is a good example of probabilistic model approximation, because conditional variance, which is a function of input variable, is an important parameter to describe a Gaussian probabilistic model. The majority of learning algorithms are based on a concept of likelihood maximization or expectation maximization method. This article presents an alternative learning algorithm based on a different concept for a multilayer perceptron. The proposed variance learning algorithm can be regarded as a kind of modified delta rule, where delta is determined by an iterative estimation algorithm, which is also proposed in this article. The proposed learning algorithm has stochastic property because the delta is stochastically determined by the estimation algorithm. Relationships of delta to the transient and steady state of the learning process are also stochastic. First, the iterative variance estimation algorithm is explained. Second, the transient state behavior is investigated to have an insight into convergence and stability properties with respect to delta. Third, the steady state analysis is described to show the relationship of delta to steady state error bound. Theoretical analysis on steady state behavior produces analytic formula for steady state error bound of the variance learning algorithm in terms of the delta. Finally, multilayer perceptron using the proposed learning algorithm is simulated for the demonstration of variance estimation.
Journal: Journal of Intelligent and Fuzzy Systems, vol. 7, no. 3, pp. 267-282, 1999
IOS Press, Inc.
6751 Tepper Drive
Clifton, VA 20124
USA
Tel: +1 703 830 6300
Fax: +1 703 830 2300
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
IOS Press
Nieuwe Hemweg 6B
1013 BG Amsterdam
The Netherlands
Tel: +31 20 688 3355
Fax: +31 20 687 0091
[email protected]
For editorial issues, permissions, book requests, submissions and proceedings, contact the Amsterdam office [email protected]
Inspirees International (China Office)
Ciyunsi Beili 207(CapitaLand), Bld 1, 7-901
100025, Beijing
China
Free service line: 400 661 8717
Fax: +86 10 8446 7947
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
如果您在出版方面需要帮助或有任何建, 件至: [email protected]