An approach for Correcting the Word-level Mispronunciations for non-native English-speaking Indian Children

Article type: Research Article

Authors: Kasture, Neha^{; *} | Jain, Pooja

Affiliations: Department of Computer Science and Engineering, Indian Institute of Information Technology, Nagpur, India

Correspondence: [*] Corresponding author. Neha Kasture, E-mail: [email protected].

Abstract:  Speech Recognition and its potential applications in terms of “talking devices” have become indispensable in today’s world. Technological advances like mobiles, smart home assistants or tablets extensively use the techniques of automatic speech recognition that works good for adults but cannot always follow and understand children’s speech. The primary goal of this paper is to bridge the gap of communication between voice assistants and Indian children speaking English as secondary language. The issue of lack of children’s speech corpora with English as non-native language, is addressed by creating a dataset of children in the age group of 5-15 years, speaking Hindi or Marathi as their mother tongue and English as their second language. The analysis and implementation of the proposed work shows the accuracy of approximately 96% and potential for further scope by increasing the size of dataset in lower age group. The key contributions of our work are (i) creating speech dataset of Indian children whose mother-tongue is Hindi or Marathi, (ii) employing and evaluating hybrid Convolutional Neural Network (CNN) as an age classifier, (iii) language modeling to customize children vocabulary, (iv) checking accuracy and performance of the system.

Keywords: Analysis of Children’s Speech, Automatic Speech Recognition, Child-Machine Interaction, Children’s Speech Recognition, Convolutional Neural Network

DOI: 10.3233/JIFS-224472

Journal: Journal of Intelligent & Fuzzy Systems, vol. 44, no. 6, pp. 10799-10813, 2023