Title
emteqPRO: Face-mounted Mask for Emotion Recognition and Affective Computing
Abstract
ABSTRACTThe paper presents the emteqPROtm system, which uses a face-mounted multi-sensor mask to measure the facial physiological responses, facial muscle activations, and motions from the user. These responses are then analyzed by machine learning algorithms to recognize and better understand the user's affective state and context, i.e., emotions, arousal, valence, stress response, activities, etc. The system can work by itself, as an open mask, or can be combined with a commercial Virtual Reality head mounted display. It comprises 3 sensor modalities: a 7-contact f-EMG sensor, a PPG sensor, and a 3-axis IMU, enabling it to measure the affective state of the user in real time. We will demonstrate how the system is used in practice in a Virtual Reality environment. This newly developed technology has the potential to significantly improve the way we collect data, design experiences, and interact within Virtual, Mixed and Augmented Realities.
Year
DOI
Venue
2021
10.1145/3460418.3479276
Ubiquitous Computing
Keywords
DocType
Citations 
Machine learning, Sensors and actuators, Ubiquitous and mobile computing, Affective computing, Facial Expressions, Emotion Recognition, Arousal, Valence, EMG, PPG, IMU, Machine Learning
Conference
0
PageRank 
References 
Authors
0.34
0
7