Camera-based fall detection using real-world versus simulated data: How far are we from the solution?

Article type: Research Article

Authors: Debard, Glen^{a; b; c; *} | Mertens, Marc^{a; d} | Deschodt, Mieke^{e; f} | Vlaeyen, Ellen^e | Devriendt, Els^{e; f} | Dejaeger, Eddy^{f; g} | Milisen, Koen^{e; f} | Tournoy, Jos^{f; g} | Croonenborghs, Tom^{b; d} | Goedemé, Toon^{c; h} | Tuytelaars, Tinne^{c; i} | Vanrumste, Bart^{b; j; k}

Affiliations: [a] Thomas More Kempen, MOBILAB, Geel, Belgium | [b] KU Leuven Technology Campus Geel, AdvISe, Geel, Belgium | [c] KU Leuven, ESAT-PSI, Leuven, Belgium | [d] KU Leuven, Department of Computer Science, DTAI, Leuven, Belgium | [e] KU Leuven, Department of Public Health and Primary Care, Health Services and Nursing Research, Belgium | [f] University Hospitals Leuven, Geriatric Medicine, Leuven, Belgium | [g] KU Leuven, Department of Clinical and Experimental Medicine, Leuven, Belgium | [h] KU Leuven Campus De Nayer, EAVISE, Sint-Katelijne-Waver, Belgium | [i] iMinds Multimedia Technologies Department, Leuven, Belgium | [j] KU Leuven, ESAT-STADIUS, Leuven, Belgium | [k] iMinds Medical Information Technology Department, Leuven, Belgium

Correspondence: [*] Corresponding author: Kleinhoefstraat 4, 2440 Geel, Belgium. Tel.: +3214802296; E-mail: [email protected].

Abstract: Several new algorithms for camera-based fall detection have been proposed, with the aim of reliably alerting caregivers about older persons’ falls at home. These algorithms have been evaluated almost exclusively using brief segments of video data captured in artificial environments under optimal conditions and with falls simulated by actors. By contrast, we collected real-life video data recorded over several months at seven older persons’ residences. Here, we report on our fall-detection algorithm based on the state-of-the-art, and we present an analysis of the real-life video data. The performance of our detection algorithm was compared with the performance of three previously reported algorithms that used a publicly available simulation data set. All four algorithms produced similar results when using the simulated data. However, the performance of our algorithm degraded drastically when evaluating falls in the real-life data. The false alarm rate was especially high, showing that some challenges still need to be met to make the system sufficiently robust to deploy in real-world situations. We conclude that using more realistic data sets that include longer video recordings and a broad range of activities are essential to reveal weaknesses in fall-detection algorithms.

Keywords: Fall detection, video surveillance, ambient assisted living, evaluation

DOI: 10.3233/AIS-160369

Journal: Journal of Ambient Intelligence and Smart Environments, vol. 8, no. 2, pp. 149-168, 2016