Paper Info
Title
Modality effects on cognitive load and performance in high-load information presentation
Abstract
In this study, we argue that modality planning in multimodal presentation systems needs to consider the modality characteristics at not only the presentational level but also the cognitive level, especially in a situation where the information load is high and the user task is time-critical. As a first step towards automatic cognitive-aware modality planning, we integrated the effect of different modalities on cognitive load and performance, using a high-load information presentation scenario. Mainly based on modality-related psychology theories, we selected five modality conditions (text, image, text+image, text+speech, and text+sound) and made hypotheses about their effects on cognitive load. Modality effects were evaluated by two cognitive load measurements and two performance measurements. Results confirmed most of the predicted modality effects, and showed that these effects become significant when the information load and the task demand are high. The findings of this study suggest that it is highly necessary to encode modality-related principles of human cognition into the modality planning procedure for systems that support high-load human-computer interaction.
Year
DOI
Venue
2009
10.1145/1502650.1502697
Journal of Applied Physics
Keywords
Field
DocType
automatic cognitive-aware modality planning,modality effect,high-load information presentation,cognitive load,modality condition,information load,cognitive load measurement,different modality,modality planning,modality planning procedure,modality characteristic,performance,heart rate variability
Modalities,Modality effect,ENCODE,Computer science,Human–computer interaction,Presentational and representational acting,Cognitive load,Cognition,Multimedia,Information presentation
Conference
Citations 
PageRank 
References 
8
0.60
5
Authors
3
Name
Order
Citations
PageRank
Yujia Cao1445.38
Mariët Theune237943.91
Anton Nijholt32356240.31