Title
Online Evaluations for Everyone: Mr. DLib's Living Lab for Scholarly Recommendations.
Abstract
We introduce the first ‘living lab’ for scholarly recommender systems. This lab allows recommender-system researchers to conduct online evaluations of their novel algorithms for scholarly recommendations, i.e., recommendations for research papers, citations, conferences, research grants, etc. Recommendations are delivered through the living lab’s API to platforms such as reference management software and digital libraries. The living lab is built on top of the recommender-system as-a-service Mr. DLib. Current partners are the reference management software JabRef and the CORE research team. We present the architecture of Mr. DLib’s living lab as well as usage statistics on the first sixteen months of operating it. During this time, 1,826,643 recommendations were delivered with an average click-through rate of 0.21%.
Year
DOI
Venue
2019
10.1007/978-3-030-15719-7_27
european conference on information retrieval
Field
DocType
Citations 
Recommender system,World Wide Web,Architecture,Information retrieval,Computer science,Living lab,Online evaluation,Digital library,Reference management software
Conference
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Joeran Beel132329.61
Andrew Collins242.13
Oliver Kopp370859.24
Linus W. Dietz401.01
Petr Knoth54615.80