Affiliations: [a]
Department of Electronic Engineering, Ming Chi University of Technology, New Taipei, Taiwan
| [b]
Department of Computer Science, University of Taipei, Taipei, Taiwan
| [c]
Department of Computer Science and Information Engineering, National Taipei University, New Taipei City, Taiwan
| [d]
Department of Information Management, Chaoyang University of Technology, Taichung City, Taiwan
| [e]
Department of Electronic Engineering, Fu Jen Catholic University, New Taipei City, Taiwan, ROC
Correspondence:
[*]
Corresponding author. Victor R.L. Shen, Department of Computer Science and Information Engineering, National Taipei University, New Taipei City, 237 Taiwan. E-mails: [email protected] or [email protected].
Abstract: Human faces have been naturally viewed as a central part in each image. One interesting task is to classify each face into different categories based on the emotion shown in the facial expression. In addition, an awareness of emotion during work on a project and how affective states are presented in the communication style might help system developers work more effectively, thus improving the performance of a collaborative team. Currently, the feasibility and portability of emotion recognition in the platform with Raspberry PI are insufficient. Hereby, a novel emotion recognition system in real time using the edge computing platform with deep learning has been implemented successfully. The feature values of objects are calculated by a high computing processor on the embedded platform. When an object with the matching features is detected, it is drawn as a rectangular bounding box and the results are displayed on the screen. In the proposed system, it first annotates the image datasets and saves them in the corresponding input data format for model training. Thus, the You Only Look Once (YOLOv5) model has been employed for training because it is a state-of-the-art object detection system. In other words, a fast and accurate emotion recognition is the main benefits of choosing YOLOv5 model. Then, the correctly trained YOLOv5 model file is loaded into an edge computing platform; and the feature values of objects are analyzed by a high computing processor. Finally, the experimental results show that the promising mean Average Precision (mAP), 92.6%, and recognition speed in Frames Per Second (FPS), 40, are obtained, which outperforms other existing systems.
Keywords: Deep learning, emotion recognition, high computing platform, face recognition, image recognition, object detection
