A non-contact mouse for surgeon-computer interaction

Article type: Research Article

Authors: Grätzel, C. | Fong, T.^{; *} | Grange, S. | Baur, C.

Affiliations: Institut de production et robotique, Ecole Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland

Correspondence: [*] Address for correspondence: Terrence Fong, IPR-LSRO, Ecole Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland. Tel.: +41 21 693 78 14; Fax: +41 21 693 65 40; E-mail: [email protected].

Abstract: We have developed a system that uses computer vision to replace standard computer mouse functions with hand gestures. The system is designed to enable non-contact human-computer interaction (HCI), so that surgeons will be able to make more effective use of computers during surgery. In this paper, we begin by discussing the need for non-contact computer interfaces in the operating room. We then describe the design of our non-contact mouse system, focusing on the techniques used for hand detection, tracking, and gesture recognition. Finally, we present preliminary results from testing and planned future work.

Keywords: vision-based interface, hand gesture recognition, surgeon-computer interaction

DOI: 10.3233/THC-2004-12304

Journal: Technology and Health Care, vol. 12, no. 3, pp. 245-257, 2004