Affiliations: Departament de Sistemes Informàtics i Computació Universitat Politècnica de València Camí de Vera sn, València, Spain
Correspondence:
[*]
Corresponding author. Lluís-F. Hurtado, Departament de Sistemes Informàtics i Computació Universitat Politècnica de València Camí de Vera sn, 46022, València, Spain
E-mail: [email protected], [email protected], [email protected].
Abstract: Natural Language Processing problems has recently been benefited for the advances in Deep Learning. Many of these problems can be addressed as a multi-label classification problem. Usually, the metrics used to evaluate classification models are different from the loss functions used in the learning process. In this paper, we present a strategy to incorporate evaluation metrics in the learning process in order to increase the performance of the classifier according to the measure we are interested to favor. Concretely, we propose soft versions of the Accuracy, micro-F1, and macro-F1 measures that can be used as loss functions in the back-propagation algorithm. In order to experimentally validate our approach, we tested our system in an Emotion Classification task proposed at the International Workshop on Semantic Evaluation, SemEval-2018. Using a Convolutional Neural Network trained with the proposed loss functions we obtained significant improvements both for the English and the Spanish corpora.
Keywords: Deep Learning, loss function, multi-label classification, Natural Language
Processing, Emotion Classification
