Paper Info
Title
Using non-verbal cues to (automatically) assess children's performance difficulties with arithmetic problems
Abstract
Intelligent tutoring systems often make use of students' answers to adapt instruction or feedback on a task. In this paper, we explore the alternative possibility of adapting a system based on the perceived affective and cognitive state of a student. A system can potentially better adapt to the needs of each individual student by using non-verbal behavior. We used a new experimental paradigm inspired by 'brain training' software to collect primary school children's answers to easy and difficult arithmetic problems and made audiovisual recordings of their answers. Adult observers rated these films on perceived difficulty level. Results showed that adults were able to correctly interpret children's perceived level of difficulty, especially if they saw their face (compared to hearing their voice). They paid attention to features such as 'looking away', and 'frowning'. Then we checked whether we could also automatically predict if the posed problem was either easy or difficult based on the first second of their response. This 'thin-slice analysis' could correctly predict the difficulty level in 71% of all cases. When trained on sufficiently many recordings, Adaptive Tutoring Systems should be able to detect children's state and adapt the difficulty level of their learning materials accordingly.
Year
DOI
Venue
2013
10.1016/j.chb.2012.10.016
Computers in Human Behavior
Keywords
Field
DocType
Facial expressions,Arithmetic problems,Performance difficulty,Affective tutoring systems
Social psychology,Arithmetic,Cognitive psychology,Psychology,Nonverbal communication,Facial expression,Software,Affect (psychology),Cognition
Journal
Volume
Issue
ISSN
29
3
0747-5632
Citations 
PageRank 
References 
2
0.46
12
Authors
4
Name
Order
Citations
PageRank
Marije van Amelsvoort192.78
Bart Joosten272.35
Emiel Krahmer3866110.30
Eric Postma414113.40