Title
A multi-componential analysis of emotions during complex learning with an intelligent multi-agent system
Abstract
Novel approach for measuring and synchronizing emotion data from three modalities.Modalities: facial expression, self-report, and electrodermal activity data.Examined if modalities identified the same emotions or complementary information.High level of agreement between the self-report and facial recognition modalities.Low level of agreement between electrodermal activation and others. This paper presents the evaluation of the synchronization of three emotional measurement methods (automatic facial expression recognition, self-report, electrodermal activity) and their agreement regarding learners' emotions. Data were collected from 67 undergraduates enrolled at a North American University whom learned about a complex science topic while interacting with MetaTutor, a multi-agent computerized learning environment. Videos of learners' facial expressions captured with a webcam were analyzed using automatic facial recognition software (FaceReader 5.0). Learners' physiological arousal was recorded using Affectiva's Q-Sensor 2.0 electrodermal activity measurement bracelet. Learners' self-reported their experience of 19 different emotional states on five different occasions during the learning session, which were used as markers to synchronize data from FaceReader and Q-Sensor. We found a high agreement between the facial and self-report data (75.6%), but low levels of agreement between them and the Q-Sensor data, suggesting that a tightly coupled relationship does not always exist between emotional response components.
Year
DOI
Venue
2015
10.1016/j.chb.2015.02.013
Computers in Human Behavior
Keywords
Field
DocType
Emotions,Affect,Computer-based learning environments,Intelligent tutoring systems (ITS)
Social psychology,Modalities,Arousal,Facial recognition system,Facial expression recognition,Psychology,Multi-agent system,Facial expression,Learning environment,Componential analysis
Journal
Volume
Issue
ISSN
48
C
0747-5632
Citations 
PageRank 
References 
25
1.20
20
Authors
5
Name
Order
Citations
PageRank
Jason Harley111410.48
François Bouchet215918.84
Md. Sazzad Hussain3956.08
Roger Azevedo421329.88
Rafael A. Calvo5103391.13