Title
Voice in Human–Agent Interaction: A Survey
Abstract
AbstractSocial robots, conversational agents, voice assistants, and other embodied AI are increasingly a feature of everyday life. What connects these various types of intelligent agents is their ability to interact with people through voice. Voice is becoming an essential modality of embodiment, communication, and interaction between computer-based agents and end-users. This survey presents a meta-synthesis on agent voice in the design and experience of agents from a human-centered perspective: voice-based human–agent interaction (vHAI). Findings emphasize the social role of voice in HAI as well as circumscribe a relationship between agent voice and body, corresponding to human models of social psychology and cognition. Additionally, changes in perceptions of and reactions to agent voice over time reveals a generational shift coinciding with the commercial proliferation of mobile voice assistants. The main contributions of this work are a vHAI classification framework for voice across various agent forms, contexts, and user groups, a critical analysis grounded in key theories, and an identification of future directions for the oncoming wave of vocal machines.
Year
DOI
Venue
2021
10.1145/3386867
ACM Computing Surveys
Keywords
DocType
Volume
Computer agent, computer voice, synthetic speech, voice perception, vocalics, conversational agents, voice assistants, robots, embodied AI, embodied agents, voice-user interface (VUI), human-agent interaction (HAI), human-computer interaction (HCI), human-robot interaction (HRI), human-machine communication (HMC)
Journal
54
Issue
ISSN
Citations 
4
0360-0300
3
PageRank 
References 
Authors
0.43
0
4
Name
Order
Citations
PageRank
Katie Seaborn115614.26
P MiyakeNorihisa230.43
PennefatherPeter330.43
Mihoko Otake-Matsuura432.12