Authors: Cardoso-Moreno, Marco A. | Luján-García, Juan Eduardo | Yáñez-Márquez, Cornelio
Article Type:
Research Article
Abstract:
In this study, a thorough analysis of the proposed approach in the context of emotion classification using both single-modal (A-13sbj) and multi-modal (B-12sbj) sets from the YAAD dataset was conducted. This dataset encompassed 25 subjects exposed to audiovisual stimuli designed to induce seven distinct emotional states. Electrocardiogram (ECG) and galvanic skin response (GSR) biosignals were collected and classified using two deep learning models, BEC-1D and ELINA, along with two different preprocessing techniques, a classical fourier-based filtering and an Empirical Mode Decomposition (EMD) approach. For the single-modal set, this proposal achieved an accuracy of 84.43±30.03, precision of 85.16±28.91, and F1-score of
…84.06±29.97. Moreover, in the extended configuration the model maintained strong performance, yielding scores of 80.95±22.55, 82.44±24.34, and 79.91±24.55, respectively. Notably, for the multi-modal set (B-12sbj), the best results were obtained with EMD preprocessing and the ELINA model. This proposal achieved an improved accuracy, precision, and F1-score scores of 98.02±3.78, 98.31±3.31, and 97.98±3.83, respectively, demonstrating the effectiveness of this approach in discerning emotional states from biosignals.
Show more
Keywords: Emotion classification, signal preprocessing, convolutional neural network, ECG, GSR, EMD
DOI: 10.3233/JIFS-219334
Citation: Journal of Intelligent & Fuzzy Systems,
vol. Pre-press, no. Pre-press, pp. 1-9, 2024
Price: EUR 27.50