An efficient method for determining the optimal convolutional neural network structure based on Taguchi method

Article type: Research Article

Authors: Lee, Pin-Chan^a | Lo, Tzu-Ping^{a; *} | Sun, Haoqing^b | Wen, I-Jyh^c

Affiliations: [a] Yuejin Technology, Ltd., Taipei, Taiwan | [b] School of Civil Engineering, Southwest Jiaotong University, Chengdu, China | [c] Department of Construction Engineering, National Yunlin University of Science and Technology, Douliu, Taiwan

Correspondence: [*] Corresponding author. Tzu-Ping Lo, Yuejin Technology, Ltd., Taipei, Taiwan. E-mail: [email protected].

Abstract: Structure of convolutional neural network (CNN) applied for image recognition requires large numbers of tuning for designated datasets in practice. It is a time-consuming process to finally come up with a feasible structure for specific requirement. This paper proposes a method based on Taguchi method which can efficiently determine the optimal structure of hyperparameters combination. Five hyperparameters with four levels are defined as control factors and two indicators are chosen to measure the performance of CNN structure. L16 (45) orthogonal array is used to arrange the experiment. S/N ratio and main effect plot are used to identify the optimal structure (hyperparameter combination) of CNN. The classic case of MNIST is employed to verify the practicability of the proposed method. Results show that the proposed method can identify the optimal CNN structure efficiently and also rank the significance priority of hyperparameters.

Keywords: Convolutional neural network, hyperparameter combination, optimization algorithm, Taguchi method

DOI: 10.3233/JIFS-190275

Journal: Journal of Intelligent & Fuzzy Systems, vol. 39, no. 3, pp. 2611-2625, 2020