Title
Emotionally-Aware Multimodal Interfaces: Preliminary Work On A Generic Affective Modality
Abstract
In interactive systems, knowing the user's emotional state is not only important to understand and improve overall user experience, but also of the utmost relevance in scenarios where such information might foster our ability to help users manage and express their emotions (e.g., anxiety), with a strong impact on their daily life and on how they interact with others. Nevertheless, although there is a clear potential for emotionally-aware applications, several challenges preclude their wider availability, sometimes resulting from the low translational nature of the research in affective computing methods, and from a lack of straightforward methods for easy integration of emotion in applications. In light of these challenges, we propose a conceptual vision for the consideration of emotion in the scope of multimodal interactive systems, and how it can articulate with research in affective computing. Aligned with this vision, a first instantiation of an affective generic modality is presented, and a proof-of-concept application, enabling multimodal interaction with Spotify, illustrates how the modality can provide emotional context in interactive scenarios.
Year
DOI
Venue
2018
10.1145/3218585.3218589
PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON SOFTWARE DEVELOPMENT AND TECHNOLOGIES FOR ENHANCING ACCESSIBILITY AND FIGHTING INFO-EXCLUSION (DSAI 2018)
Keywords
DocType
Citations 
Emotional and affective interaction, multimodal interfaces, multi platform design, natural interaction
Conference
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Tiago Henriques100.34
Samuel S. Silva23114.23
Susana Brás301.35
Sandra C. Soares401.69
Nuno Almeida54710.10
António J. S. Teixeira615235.26