Title
Challenges in Evaluating Interactive Visual Machine Learning Systems
Abstract
In interactive visual machine learning (IVML), humans and machine learning algorithms collaborate to achieve tasks mediated by interactive visual interfaces. This human-in-the-loop approach to machine learning brings forth not only numerous intelligibility, trust, and usability issues, but also many open questions with respect to the evaluation of the IVML system, both as separate components, and as a holistic entity that includes both human and machine intelligence. This article describes the challenges and research gaps identified in an IEEE VIS workshop on the evaluation of IVML systems.
Year
DOI
Venue
2020
10.1109/MCG.2020.3017064
IEEE Computer Graphics and Applications
Keywords
DocType
Volume
interactive visual interfaces,human-in-the-loop,human machine intelligence,IVML system evaluation,interactive visual machine learning system evaluation
Journal
40
Issue
ISSN
Citations 
6
0272-1716
0
PageRank 
References 
Authors
0.34
0
10
Name
Order
Citations
PageRank
Nadia Boukhelifa11019.85
Anastasia Bezerianos267437.75
Remco Chang398364.96
Christopher Collins4103749.74
steven m drucker52399286.15
Alex Endert697452.18
Jessica Hullman747726.51
C North800.34
Michael Sedlmair991551.74
Theresa-Marie Rhyne1019424.14