Title
Familiarity Vs Trust: A Comparative Study of Domain Scientists' Trust in Visual Analytics and Conventional Analysis Methods.
Abstract
Combining interactive visualization with automated analytical methods like statistics and data mining facilitates data-driven discovery. These visual analytic methods are beginning to be instantiated within mixed-initiative systems, where humans and machines collaboratively influence evidence-gathering and decision-making. But an open research question is that, when domain experts analyze their data, can they completely trust the outputs and operations on the machine-side? Visualization potentially leads to a transparent analysis process, but do domain experts always trust what they see? To address these questions, we present results from the design and evaluation of a mixed-initiative, visual analytics system for biologists, focusing on analyzing the relationships between familiarity of an analysis medium and domain experts' trust. We propose a trust-augmented design of the visual analytics system, that explicitly takes into account domain-specific tasks, conventions, and preferences. For evaluating the system, we present the results of a controlled user study with 34 biologists where we compare the variation of the level of trust across conventional and visual analytic mediums and explore the influence of familiarity and task complexity on trust. We find that despite being unfamiliar with a visual analytic medium, scientists seem to have an average level of trust that is comparable with the same in conventional analysis medium. In fact, for complex sense-making tasks, we find that the visual analytic system is able to inspire greater trust than other mediums. We summarize the implications of our findings with directions for future research on trustworthiness of visual analytic systems.
Year
DOI
Venue
2017
10.1109/TVCG.2016.2598544
IEEE Trans. Vis. Comput. Graph.
Keywords
Field
DocType
Visual analytics,Data visualization,Biology,Uncertainty,Data analysis,Bioinformatics
Open research,Data science,Computer vision,Data visualization,Computer science,Visualization,Visual analytics,Interactive visualization,Interactive visual analysis,Artificial intelligence,Cultural analytics,Analytics
Journal
Volume
Issue
ISSN
23
1
1941-0506
Citations 
PageRank 
References 
6
0.42
20
Authors
7
Name
Order
Citations
PageRank
Aritra Dasgupta117512.02
Joon-Yong Lee234234.23
Ryan Wilson371.11
Robert A Lafrance460.42
Nick Cramer560.42
Kristin Cook660.76
Samuel H Payne7103.01