Name
Abstract | ||
|---|---|---|
Providing high-quality news recommendations is a challenging task because the set of potentially relevant news items changes continuously, the relevance of news highly depends on the context, and there are tight time constraints for computing recommendations. The CLEF NewsREEL challenge is a campaign-style evaluation lab allowing participants to evaluate and optimize news recommender algorithms online and offline. In this paper, we discuss the objectives and challenges of the NewsREEL lab. We motivate the metrics used for benchmarking the recommender algorithms and explain the challenge dataset. In addition, we introduce the evaluation framework that we have developed. The framework makes possible the reproducible evaluation of recommender algorithms for stream data, taking into account recommender precision as well as the technical complexity of the recommender algorithms. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1007/978-3-319-24027-5_48 | Cross-Language Evaluation Forum |
Keywords | Field | DocType |
Recommender systems,News,Evaluation,Living lab,Stream-based recommender | Recommender system,World Wide Web,Information retrieval,Computer science,Stream data,Online and offline,Living lab,Clef,Benchmarking | Conference |
Volume | ISSN | Citations |
9283 | 0302-9743 | 8 |
PageRank | References | Authors |
0.58 | 23 | 8 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| benjamin kille | 1 | 92 | 13.56 |
| Andreas Lommatzsch | 2 | 479 | 40.83 |
| Roberto Turrin | 3 | 859 | 34.94 |
| András Serény | 4 | 38 | 3.25 |
| Martha Larson | 5 | 1661 | 116.07 |
| Torben Brodt | 6 | 91 | 7.22 |
| Jonas Seiler | 7 | 35 | 3.18 |
| Frank Hopfgartner | 8 | 535 | 57.69 |