Title
Temporal analysis of multimodal data to predict collaborative learning outcomes
Abstract
The analysis of multiple data streams is a long-standing practice within educational research. Both multimodal data analysis and temporal analysis have been applied successfully, but in the area of collaborative learning, very few studies have investigated specific advantages of multiple modalities versus a single modality, especially combined with temporal analysis. In this paper, we investigate how both the use of multimodal data and moving from averages and counts to temporal aspects in a collaborative setting provides a better prediction of learning gains. To address these questions, we analyze multimodal data collected from 25 9-11-year-old dyads using a fractions intelligent tutoring system. Assessing the relation of dual gaze, tutor log, audio and dialog data to students' learning gains, we find that a combination of modalities, especially those at a smaller time scale, such as gaze and audio, provides a more accurate prediction of learning gains than models with a single modality. Our work contributes to the understanding of how analyzing multimodal data in temporal manner provides additional information around the collaborative learning process.
Year
DOI
Venue
2020
10.1111/bjet.12982
BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY
DocType
Volume
Issue
Journal
51.0
5.0
ISSN
Citations 
PageRank 
0007-1013
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Jennifer K. Olsen12211.52
Kshitij Sharma212931.52
Nikol Rummel345657.13
Vincent Aleven41700193.45