Paper Info
Title
The Bursts and Lulls of Multimodal Interaction: Temporal Distributions of Behavior Reveal Differences Between Verbal and Non-Verbal Communication.
Abstract
Recent studies of naturalistic face-to-face communication have demonstrated coordination patterns such as the temporal matching of verbal and non-verbal behavior, which provides evidence for the proposal that verbal and non-verbal communicative control derives from one system. In this study, we argue that the observed relationship between verbal and non-verbal behaviors depends on the level of analysis. In a reanalysis of a corpus of naturalistic multimodal communication (Louwerse, Dale, Bard, & Jeuniaux, ), we focus on measuring the temporal patterns of specific communicative behaviors in terms of their burstiness. We examined burstiness estimates across different roles of the speaker and different communicative modalities. We observed more burstiness for verbal versus non-verbal channels, and for more versus less informative language subchannels. Using this new method for analyzing temporal patterns in communicative behaviors, we show that there is a complex relationship between verbal and non-verbal channels. We propose a temporal heterogeneity hypothesis to explainhow the language system adapts to the demands of dialog.
Year
DOI
Venue
2018
10.1111/cogs.12612
COGNITIVE SCIENCE
Keywords
Field
DocType
Multimodal interaction,Verbal communication,Nonverbal communication,Temporal distributions,Burstiness
Modalities,Dialog box,Multimodal interaction,Interpersonal communication,Psychology,Cognitive psychology,Nonverbal communication,Burstiness,Statistical hypothesis testing,Level of analysis
Journal
Volume
Issue
ISSN
42
4.0
0364-0213
Citations 
PageRank 
References 
0
0.34
10
Authors
4
Name
Order
Citations
PageRank
Drew H. Abney153.08
Rick Dale2373.80
Max M. Louwerse315827.54
Christopher T. Kello45217.29