Title
Exploring the Use of a Robust Depth-sensor-based Avatar Control System and its Effects on Communication Behaviors
Abstract
To interact as fully-tracked avatars with rich hand gestures in Virtual Reality (VR), we often need to wear a tracking suit or attach extra sensors on our bodies. User experience and performance may be impacted by the cumbersome devices and low fidelity behavior representations, especially in social scenarios where good communication is required. In this paper, we use multiple depth sensors and focus on increasing the behavioral fidelity of a participant’s virtual body representation. To investigate the impact of the depth-sensor-based avatar system (full-body tracking with hand gestures), we compared it against a controller-based avatar system (partial-body tracking with limited hand gestures). We designed a VR interview simulation for a single user to measure the effects on presence, virtual body ownership, workload, usability, and perceived self-performance. Specifically, the interview process was recorded in VR, together with all the verbal and non-verbal cues. Subjects then took a third-person view to evaluate their previous performance. Our results show that the depth-sensor-based avatar control system increased virtual body ownership and also improved the user experience. In addition, users rated their non-verbal behavior performance higher in the full-body depth-sensor-based avatar system.
Year
DOI
Venue
2019
10.1145/3359996.3364267
25th ACM Symposium on Virtual Reality Software and Technology
Keywords
Field
DocType
avatar control, communication behavior, depth sensor, motion capture, tracking, virtual reality
Computer vision,Computer science,Artificial intelligence,Control system,Avatar
Conference
ISBN
Citations 
PageRank 
978-1-4503-7001-1
2
0.37
References 
Authors
0
5
Name
Order
Citations
PageRank
Yuanjie Wu131.12
Yu Wang220.37
Sungchul Jung33810.61
Simon Hoermann45413.53
Robert W. Lindeman5739108.93