Title
Understanding and Evaluating User Satisfaction with Music Discovery.
Abstract
We study the use and evaluation of a system for supporting music discovery, the experience of finding and listening to content previously unknown to the user. We adopt a mixed methods approach, including interviews, unsupervised learning, survey research, and statistical modeling, to understand and evaluate user satisfaction in the context of discovery. User interviews and survey data show that users' behaviors change according to their goals, such as listening to recommended tracks in the moment, or using recommendations as a starting point for exploration. We use these findings to develop a statistical model of user satisfaction at scale from interactions with a music streaming platform. We show that capturing users' goals, their deviations from their usual behavior, and their peak interactions on individual tracks are informative for estimating user satisfaction. Finally, we present and validate heuristic metrics that are grounded in user experience for online evaluation of recommendation performance. Our findings, supported with evidence from both qualitative and quantitative studies, reveal new insights about user expectations with discovery and their behavioral responses to satisfying and dissatisfying systems.
Year
DOI
Venue
2018
10.1145/3209978.3210049
SIGIR
Keywords
Field
DocType
music recommendation,discovery,user behavior,mixed methods
Survey data collection,Heuristic,User experience design,User expectations,Information retrieval,Computer science,Active listening,Unsupervised learning,Survey research,Statistical model
Conference
ISBN
Citations 
PageRank 
978-1-4503-5657-2
2
0.36
References 
Authors
21
5
Name
Order
Citations
PageRank
Jean Garcia-Gathright1154.06
Brian St. Thomas282.20
Christine Hosey382.20
Zahra Nazari442.20
Fernando Diaz5198597.72