Paper Info
Title
Towards Cognitive-Aware Multimodal Presentation: The Modality Effects in High-Load HCI
Abstract
In this study, we argue that multimodal presentations should be created in a cognitive-aware manner, especially in a high-load HCI situation where the user task challenges the full capacity of the human cognition. An experiment was conducted to investigate the cognitive effects of modalities, using a high-load task. The performance measurements and subjective reports consistently confirm a significant modality impact on cognitive workload, stress and performance. A relation between modality usage and physiological states was not found, due to the insufficient sensitivity and individual differences of the physiological measurements. The findings of this experiment can be well explained by several modality-related cognitive theories. We further integrate these theories into a suitability prediction model, which can systematically predict how suitable a certain modality usage is for this presentation task. The model demonstrates a possible approach towards cognitive-aware modality planning and can be modified for other applications.
Year
DOI
Venue
2009
10.1007/978-3-642-02728-4_1
HCI (17)
Keywords
Field
DocType
cognitive effect,cognitive-aware modality planning,modality-related cognitive theory,high-load hci,certain modality usage,high-load task,presentation task,modality effects,modality usage,cognitive workload,towards cognitive-aware multimodal presentation,significant modality impact,user task,cognitive load,human cognition,prediction model
Modalities,Cognitive psychology,Psychology,Cognitive workload,Cognitive load,Cognition,Multimedia
Conference
Volume
ISSN
Citations 
5639
0302-9743
2
PageRank 
References 
Authors
0.39
3
3
Name
Order
Citations
PageRank
Yujia Cao1445.38
Mariët Theune237943.91
Anton Nijholt32356240.31