Shared learning activity labels across heterogeneous datasets

Article type: Research Article

Authors: Ye, Juan^{; *}

Affiliations: School of Computer Science, University of St Andrews, UK. E-mail: [email protected]

Correspondence: [*] Corresponding author. E-mail: [email protected].

Abstract: Nowadays, the advancement of sensing and communication technologies has led to the possibility of collecting a large amount of sensor data, however, to build a reliable computational model and accurately recognise human activities we still need the annotations on sensor data. Acquiring high-quality, detailed, continuous annotations is a challenging task. In this paper, we explore the solution space on sharing annotated activities across different datasets in order to enhance the recognition accuracies. The main challenge is to resolve heterogeneity in feature and activity space between datasets; that is, each dataset can have a different number of sensors in heterogeneous sensing technologies and deployed in diverse environments and record various activities on different users. To address the challenge, we have designed and developed sharing data and sharing classifiers algorithms that feature the knowledge model to enable computationally-efficient feature space remapping and uncertainty reasoning to enable effective classifier fusion. We have validated the algorithms on three third-party real-world datasets and demonstrated their effectiveness in recognising activities only with annotations from as little as 0.1% of each dataset.

Keywords: Activity recognition, uncertainty reasoning, feature space remapping, ontologies, smart home, transfer learning

DOI: 10.3233/AIS-210590

Journal: Journal of Ambient Intelligence and Smart Environments, vol. 13, no. 2, pp. 77-94, 2021