Development process of an affective bi-modal Intelligent Tutoring System

Article type: Research Article

Authors: Alepis, Efthymios^{a; *} | Virvou, Maria^a | Kabassi, Katerina^b

Affiliations: [a] Department of Informatics, University of Piraeus, 80 Karaoli & Dimitriou St., 18534 Piraeus, Greece | [b] Department of Ecology and the Environment, Technological Educational Institute of the Ionian Islands, 2 Kalvou Sq., 29100 Zakynthos, Greece

Correspondence: [*] Corresponding author. E-mail: [email protected]

Abstract: This paper presents the development process of an Intelligent Tutoring System that performs emotion recognition on the basis of two modalities: keyboard and microphone. The system uses a multi-criteria theory to combine information about the user emotions through the two modalities. In this paper we focus on presenting and discussing the experimental studies that were conducted for the purposes of the design of the system. The experimental studies yield results concerning the way that human observers perform emotion recognition on other humans and then we show how we use these results to design the reasoning mechanism of the Intelligent Tutoring system that performs emotion recognition.

Keywords: Affective modelling, bi-modal interaction, multi-criteria decision making, software life-cycle

DOI: 10.3233/IDT-2007-1302

Journal: Intelligent Decision Technologies, vol. 1, no. 3, pp. 117-126, 2007