Real time human action recognition from RGB clips using local motion histogram

Article type: Research Article

Authors: Srivastava, Awadhesh Kumar^{a; b; *} | Biswas, K.K.^c

Affiliations: [a] UTU Dehradun, Dehradun, India | [b] KIET Group of Institutions, Ghaziabad, India | [c] Bennett University, Greater Noida, India

Correspondence: [*] Corresponding author: Awadhesh Kumar Srivastava, UTU Dehradun, Dehradun, India. %****␣idt-13-idt170175_temp.tex␣Line␣25␣**** E-mail: [email protected].

Abstract: This paper proposes a method to human action recognition from RGB video clips. The method is based on capturing the local motion information from smaller size video clips. Local motion information is captured through accumulation of motion in different shape and size of patches of spatial domain. The motion information is then transformed to motion histograms. Further, all the histograms are concatenated to make the proposed feature vector. Bagging ensemble technique, in form of random forest, is used for classification. The idea is further extended to real time human action recognition mechanism. To show the robustness and efficiency of proposed algorithm, it is performed on publicly available human action datasets Joint-annotated Human Motion Data Base (JHMDB) [29] and University of Rzeszów (UR) Fall detection dataset [19]. The results are also compared with other state of art methods.

Keywords: Human action recognition, histogram, random forest, RGB camera, real time fall detection

DOI: 10.3233/IDT-170175

Journal: Intelligent Decision Technologies, vol. 13, no. 2, pp. 219-228, 2019