Tutorial on application-oriented evaluation of recommendation systems

Article type: Research Article

Authors: Shani, Guy^; | Gunawardana, Asela

Affiliations: Information System Engineering, Ben Gurion University, Beer-Sheva, Israel. E-mail: [email protected] | Microsoft Research, Redmond, WA, USA. E-mail: [email protected]

Note: [] Corresponding author: Guy Shani. E-mail: [email protected]

Abstract: Recommendation systems are now widely used in many commercial applications. This tutorial focuses on the evaluation of such systems, from an application-oriented view. The tutorial recommends best practices, suggests a protocol for the evaluation process, and reviews a set of metrics that can be evaluated. The practices in this paper are motivated by similar procedures in nearby areas, such as machine learning, and information retrieval.

Keywords: Recommender systems, evaluation

DOI: 10.3233/AIC-130551

Journal: AI Communications, vol. 26, no. 2, pp. 225-236, 2013