Title
An initial exploration of conversational errors as a novel method for evaluating virtual human experiences
Abstract
We present a new method for evaluating user experience in interactions with virtual humans (VHs). We code the conversational errors made by the VH. These errors, in addition to the duration of the interaction and the numbers of statements made by the participant and the VH, provide objective, quantitative data about the virtual social interaction. We applied this method to a set of previously collected interactions between medical students and VH patients and present preliminary results. The error metrics do not correlate with traditional measures of the quality of a virtual experience, e.g. presence and copresence questionnaires. The error metrics were significantly correlated with scores on the Maastricht Assessment of Simulated Patients (MaSP), a scenario-appropriate measure of simulation quality, suggesting further investigation is warranted.
Year
DOI
Venue
2011
10.1109/VR.2011.5759489
VR
Keywords
Field
DocType
virtual human,novel method,error metrics,present preliminary result,virtual human experience,user experience,new method,virtual social interaction,virtual experience,simulation quality,initial exploration,vh patient,conversational error,measurement uncertainty,virtual reality,social interaction,embodied agent,virtual environment,solid modeling
Social relation,Simulated patient,User experience design,Virtual machine,Virtual reality,Computer science,Simulation,Human–computer interaction,Solid modeling,Virtual actor
Conference
ISSN
Citations 
PageRank 
1087-8270
2
0.45
References 
Authors
10
5
Name
Order
Citations
PageRank
R Skarbez120.45
A Kotranza220.45
Frederick P. Brooks, Jr.333931659.47
Benjamin Lok426625.24
M C. Whitton5864.87