TrumpetNet: A Convolutional Neural Network with Self-Attention Mechanisms for visual detection of trumpet fingering

Article type: Research Article

Authors: Valdez-Rodríguez, José E. | Rangel, Nahum | Moreno-Armendáriz, Marco A.^{; *}

Affiliations: Center for Computing Research, Instituto Politécnico Nacional, Mexico City, Mexico

Correspondence: [*] Corresponding author. Marco A. Moreno-Armendáriz, Center for Computing Research, Instituto Politécnico Nacional, Mexico City, Mexico. Email: [email protected].

Abstract: Visual detection of fingering on the trumpet is an increasingly interesting topic in music research. The ability to recognize and track the movements of the trumpet player’s fingers during the performance of a musical piece can provide valuable information for analyzing and improving instrument technique. However, this is a largely unexplored task, as most works focus on audio quality rather than instrument fingering techniques. Developing techniques for identifying essential finger positions on a musical instrument is crucial, as poor fingering techniques can harm instrument performance. In this work, we propose the visual detection of this fingering using convolutional neural networks with a proprietary dataset created for this purpose. Additionally, to improve the results and focus on the essential parts of the instrument, we use self-attention mechanisms by extracting these features automatically.

Keywords: Fingering detection, Convolutional Neural Networks, Self-attention mechanisms, Visual detection, Trumpet

DOI: 10.3233/JIFS-219342

Journal: Journal of Intelligent & Fuzzy Systems, vol. Pre-press, no. Pre-press, pp. 1-9, 2024