Title
Evaluating Collaborative Filtering Recommender Algorithms: A Survey.
Abstract
Due to the explosion of available information on the Internet, the need for effective means of accessing and processing them has become vital for everyone. Recommender systems have been developed to help users to find what they may be interested in and business owners to sell their products more efficiently. They have found much attention in both academia and industry. A recommender algorithm takes into account user-item interactions, i.e., rating (or purchase) history of users on items, and their contextual information, if available. It then provides a list of potential items for each target user, such that the user is likely to positively rate (or purchase) them. In this paper, we review evaluation metrics used to assess performance of recommendation algorithms. We also survey a number of classical and modern recommendation algorithms and compare their performance in terms of different evaluation metrics on five benchmark datasets. Our experiments show that there is no golden recommendation algorithm showing the best performance in all evaluation metrics. We also find large variability across the datasets. This indicates that one should carefully consider the evaluation criteria in choosing a recommendation algorithm for a particular application.
Year
DOI
Venue
2018
10.1109/ACCESS.2018.2883742
IEEE ACCESS
Keywords
Field
DocType
Recommender systems,collaborative filtering,evaluation metrics,precision,ranking,diversity
Recommender system,Contextual information,Collaborative filtering,Ranking,Computer science,Algorithm,Prediction algorithms,The Internet
Journal
Volume
ISSN
Citations 
6
2169-3536
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Mahdi Jalili131437.98
Sajad Ahmadian2745.24
Maliheh Izadi300.34
Parham Moradi443018.41
Mostafa E. Salehi511113.74