Searching for just a few words should be enough to get started. If you need to make more complex queries, use the tips below to guide you.
Article type: Research Article
Authors: Pundhir, Sandhyaa; * | Ghose, Udayana | Bisht, Upasanab
Affiliations: [a] USICT, GGSIPU, Dwarka, Delhi, India | [b] KIT, Pitampura, Delhi, India
Correspondence: [*] Corresponding author. Sandhya Pundhir, USICT, GGSIPU, Dwarka, Delhi, India. E-mail: [email protected].
Abstract: One of the momentous transformation performed by an artificial neural network (ANN), Support Vector Machine (SVM), Radial basis Function (RBF) and many other machine learning method is the application of activation function. MyAct the proposed activation method is used here with various ANN architectures for link prediction, classification and general prediction. Statistical properties of data used here to prove the effectiveness of proposed activation function MyAct over other popular activation methods. A data dependent transfer method is developed, which is pioneer in its own way. This proves to be an unified formulation for the robust and generalised learning for the classification, link prediction and regression problem types. Classification is done with Iris dataset using ANN with different activation method and results are compared. Improved results are achieved when MyAct used with Tailored Deep Feed Forward Artificial Neural Network (TDFFANN), simple Artificial Neural Network and Deep Artificial Neural Network. Aim here is to develop a novel activation method which work with positive data, negative data, small size data, big size data, skewed data or corrupt data. An attempt is made to cover complete versatile behaviour of data. Currently not a single activation method can work well on all above mentioned data. Results obtained using MyAct on the datasets used here proves it to be a good choice in comparison to logsig, tansig and other popular activation methods for classification and link prediction. Satisfactory improvement is achieved by using data length as well as negative range values in the prediction done by proposed method. MyAct had 22% better standard deviation than ReLU (Rectified Linear unit) and 36. 28% better standard deviation than ELU (Exponential linear unit). MyAct has 2. 6% better accuracy in regression error than Swiss method and 2. 5% better accuracy in regression error than ELU. Other results are discussed in the paper.
Keywords: Artificial neural network, activation function, feedforward neural network, deep learning, ink prediction, machine learning
DOI: 10.3233/JIFS-191618
Journal: Journal of Intelligent & Fuzzy Systems, vol. 39, no. 1, pp. 665-677, 2020
IOS Press, Inc.
6751 Tepper Drive
Clifton, VA 20124
USA
Tel: +1 703 830 6300
Fax: +1 703 830 2300
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
IOS Press
Nieuwe Hemweg 6B
1013 BG Amsterdam
The Netherlands
Tel: +31 20 688 3355
Fax: +31 20 687 0091
[email protected]
For editorial issues, permissions, book requests, submissions and proceedings, contact the Amsterdam office [email protected]
Inspirees International (China Office)
Ciyunsi Beili 207(CapitaLand), Bld 1, 7-901
100025, Beijing
China
Free service line: 400 661 8717
Fax: +86 10 8446 7947
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
如果您在出版方面需要帮助或有任何建, 件至: [email protected]