Affiliations: [a]
Department of Computer Science and Engineering, Sri Eshwar College of Engineering, Coimbatore, Tamilnadu, India
| [b]
Department of Computer Science and Engineering, Bannari Amman Institute of Technology, Erode, Tamilnadu, India
Correspondence:
[*]
Corresponding author. S. Yuvaraj, Department of Computer Science and Engineering, Sri Eshwar College of Engineering, Coimbatore, Tamilnadu, India. E-mail: [email protected].
Abstract: The predictions of cognitive emotions are complex due to various cognitive emotion modalities. Deep network model has recently been used with huge cognitive emotion determination. The visual and auditory modalities of cognitive emotion recognition system are proposed. The extraction of powerful features helps obtain the content related to cognitive emotions for different speaking styles. Convolutional neural network (CNN) is utilized for feature extraction from the speech. On the other hand, the visual modality uses the 50 layers of a deep residual network for prediction purpose. Also, extracting features is important as the datasets are sensitive to outliers when trying to model the content. Here, a long short-term memory network (LSTM) is considered to manage the issue. Then, the proposed Dense Layer Model (DLM) is trained in an E2E manner based on feature correlation that provides better performance than the conventional techniques. The proposed model gives 99% prediction accuracy which is higher to other approaches.
Keywords: Cognitive emotion recognition, deep learning, prediction, visual modality, handcrafted features
