Paper Info
Title
Empirical Evaluation of the Interplay of Emotion and Visual Attention in Human-Virtual Human Interaction.
Abstract
We examined the effect of rendering style and the interplay between attention and emotion in users during interaction with a virtual patient in a medical training simulator. The virtual simulation was rendered representing a sample from the photo-realistic to the non-photorealistic continuum, namely Near-Realistic, Cartoon or Pencil-Shader. In a mixed design study, we collected 45 participants’ emotional responses and gaze behavior using surveys and an eye tracker while interacting with a virtual patient who was medically deteriorating over time. We used a cross-lagged panel analysis of attention and emotion to understand their reciprocal relationship over time. We also performed a mediation analysis to compare the extent to which the virtual agent’s appearance and his affective behavior impacted users’ emotional and attentional responses. Results showed the interplay between participants’ visual attention and emotion over time and also showed that attention was a stronger variable than emotion during the interaction with the virtual human.
Year
DOI
Venue
2019
10.1145/3343036.3343118
SAP
Field
DocType
ISBN
Reciprocal,Computer vision,Mediation (statistics),Panel analysis,Gaze,Computer science,Cognitive psychology,Virtual patient,Eye tracking,Artificial intelligence,Virtual actor,Rendering (computer graphics)
Conference
978-1-4503-6890-2
Citations 
PageRank 
References 
1
0.35
0
Authors
5
Name
Order
Citations
PageRank
Matias Volonte133.08
Reza Ghaiumy Anaraky212.71
Bart P. Knijnenburg371148.88
Andrew T. Duchowski4835142.62
Sabarish V. Babu517425.34