Title
Evaluating narrative-driven movie recommendations on Reddit
Abstract
Recommender systems have become omni-present tools that are used by a wide variety of users in everyday life tasks, such as finding products in Web stores or online movie streaming portals. However, in situations where users already have an idea of what they are looking for (e.g., 'The Lord of the Rings', but in space with a dark vibe), most traditional recommender algorithms struggle to adequately address such a priori defined requirements. Therefore, users have built dedicated discussion boards to ask peers for suggestions, which ideally fulfill the stated requirements. In this paper, we set out to determine the utility of well-established recommender algorithms for calculating recommendations when provided with such a narrative. To that end, we first crowdsource a reference evaluation dataset from human movie suggestions. We use this dataset to evaluate the potential of five recommendation algorithms for incorporating such a narrative into their recommendations. Further, we make the dataset available for other researchers to advance the state of research in the field of narrative-driven recommendations. Finally, we use our evaluation dataset to improve not only our algorithmic recommendations, but also existing empirical recommendations of IMDb. Our findings suggest that the implemented recommender algorithms yield vastly different suggestions than humans when presented with the same a priori requirements. However, with carefully configured post-filtering techniques, we can outperform the baseline by up to 100%. This represents an important first step towards more refined algorithmic narrative-driven recommendations.
Year
DOI
Venue
2019
10.1145/3301275.3302287
Proceedings of the 24th International Conference on Intelligent User Interfaces
Keywords
Field
DocType
crowdsourcing, dataset, narrative-driven recommendations
Recommender system,World Wide Web,Everyday life,Ask price,Crowdsourcing,Computer science,A priori and a posteriori,Crowdsource,Discussion board,Narrative,Human–computer interaction
Conference
ISBN
Citations 
PageRank 
978-1-4503-6272-6
0
0.34
References 
Authors
20
4
Name
Order
Citations
PageRank
Lukas Eberhard1143.15
Simon Walk29714.43
Lisa Posch3195.44
Denis Helic427837.16