Virtual interaction algorithm of cultural heritage based on multi feature fusion

Article type: Research Article

Authors: Li, Hao

Affiliations: College of Humanities, Minjiang University, Fuzhou, Fujian 350108, China | E-mail: [email protected]

Correspondence: [*] Corresponding author: College of Humanities, Minjiang University, Fuzhou, Fujian 350108, China. E-mail: [email protected].

Abstract: During the traditional cultural heritage virtual interaction algorithm in the interaction action recognition, the database is too single, resulting in low recognition accuracy, recognition time-consumer and other issues. Therefore, this paper introduces the multi feature fusion method to optimize the cultural heritage virtual interaction algorithm. Kinect bone tracking technology is applied to identify the movement of the tracking object, 20 joints of the human body are tracked, and interactive action recognition is realized according to the fingertip candidate points. In order to carry out the judgment virtual interactive operation of subsequent recognition actions, a multi feature fusion database is established. The mean shift is used to derive the moving mean of the target’s action position and to track the interactive object. The Euclidean distance formula is used to train samples of multi feature fusion database data to realize the judgment of recognition action and virtual interaction. In order to verify the feasibility of the research algorithm, the virtual interactive script of ink painting in a cultural heritage museum is used to simulate the research algorithm, and a comparative experiment is designed. The experimental results show that the proposed algorithm is superior to the traditional virtual interactive algorithm in recognition accuracy and efficiency, which proves the feasibility of this method.

Keywords: Virtual interaction; action recognition; candidate points; multi feature fusion; kinect bone tracking; mean shift

DOI: 10.3233/JCM-215698

Journal: Journal of Computational Methods in Sciences and Engineering, vol. 22, no. 1, pp. 333-347, 2022