Multi-domain framework for multimedia archiving using multimodal interaction

Article type: Research Article

Authors: Mendonça, Hildeberto^a | Vybornova, Olga^{a; b} | Lawson, Jean-Yves Lionel^a | Macq, Benoit^{a; *}

Affiliations: [a] Laboratoire de Télécommunications et Télédétection (TELE), Université catholique de Louvain (UCL), Louvain-la-Neuve, Belgium | [b] Dynamic Intelligent Systems Lab, Institute for System Analysis of the Russian Academy of Sciences, Moscow, Russia

Correspondence: [*] Corresponding author: Benoit Macq, Head of Unit Laboratoire de Télécommunications et Télédétection – TELE, Université catholique de Louvain – UCL, Bâtiment Stévin – 2, Place du Levant B – 1348 Louvain-la-Neuve, Belgium. Tel.: +32 10 47 2271; Fax: +32 10 47 2089; E-mail: [email protected].

Abstract: Multimedia content is very rich in terms of meaning, and archiving systems need to be improved to consider such richness. This research proposes archiving improvements to extend the ways of describing content, and enhance user interaction with multimedia archiving systems beyond the traditional text typing and mouse pointing. These improvements consider a set of techniques to segment different kinds of media, a set of indexes to annotate the supported segmentation techniques and an extensible multimodal interaction to make multimedia archiving tasks more user friendly.

Keywords: Multimedia archival, multimodal interaction, segmentation, annotation

DOI: 10.3233/ICA-2011-0360

Journal: Integrated Computer-Aided Engineering, vol. 18, no. 1, pp. 15-28, 2011