Title
A Survey Of Human-Centered Evaluations In Human-Centered Machine Learning
Abstract
Visual analytics systems integrate interactive visualizations and machine learning to enable expert users to solve complex analysis tasks. Applications combine techniques from various fields of research and are consequently not trivial to evaluate. The result is a lack of structure and comparability between evaluations. In this survey, we provide a comprehensive overview of evaluations in the field of human-centered machine learning. We particularly focus on human-related factors that influence trust, interpretability, and explainability. We analyze the evaluations presented in papers from top conferences and journals in information visualization and human-computer interaction to provide a systematic review of their setup and findings. From this survey, we distill design dimensions for structured evaluations, identify evaluation gaps, and derive future research opportunities.
Year
DOI
Venue
2021
10.1111/cgf.14329
COMPUTER GRAPHICS FORUM
DocType
Volume
Issue
Journal
40
3
ISSN
Citations 
PageRank 
0167-7055
1
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
Fabian Sperrle1263.94
Mennatallah El-Assady212013.73
Grace Guo310.68
Rita Borgo426618.44
Duen Horng Chau5126086.87
Alex Endert610.34
Alex Endert797452.18