Title
Children's Play and Problem Solving in Motion-Based Educational Games: Synergies between Human Annotations and Multi-Modal Data
Abstract
Identifying and supporting children's play and problem solving behaviour is important for designing educational technologies. This can inform feedback mechanisms to scaffold learning (provide hints or progress information), and assist facilitators (teachers, parents) in supporting children. Traditionally, researchers manually code video to dissect children's nuanced play and problem solving behaviour. Advancements in sensing technologies and their respective Multi-Modal Data (MMD), afford observation of invisible states (cognitive, affective, physiological), and provide opportunities to inspect internal processes experienced during learning and play. However, limited research combines traditional video annotations and MMD to understand children's behaviour as they interact with educational technology. To address this concern, we collected data from webcam, wristband, eye-trackers, and Kinect, as 26 children, aged 10-12, played a Motion-Based Educational Games (MBEG). Results showed significant differences in children's experience during play and problem solving episodes, and motivate design considerations aimed to facilitate children's interactions with MBEG.
Year
DOI
Venue
2021
10.1145/3459990.3460702
IDC '21: PROCEEDINGS OF INTERACTION DESIGN AND CHILDREN 2021
Keywords
DocType
Citations 
play, problem solving, motion-based games, sensors, education, learning, multi-modal data
Conference
1
PageRank 
References 
Authors
0.37
0
5
Name
Order
Citations
PageRank
Serena Lee-Cultura112.74
Kshitij Sharma212931.52
Giulia Cosentino315.44
Sofia Papavlasopoulou44012.48
Michail N. Giannakos558688.22