Title
Learning Deep Spatiotemporal Feature for Engagement Recognition of Online Courses
Abstract
This paper focuses on the study of engagement recognition of online courses from students' appearance and behavioral information using deep learning methods. Automatic engagement recognition can be applied to developing effective online instructional and assessment strategies for promoting learning. In this paper, we make two contributions. First, we propose a Convolutional 3D (C3D) neural networks-based approach to automatic engagement recognition, which models both the appearance and motion information in videos and recognize student engagement automatically. Second, we introduce the Focal Loss to address the class-imbalanced data distribution problem in engagement recognition by adaptively decreasing the weight of high engagement samples while increasing the weight of low engagement samples in deep spatiotemporal feature learning. Experiments on the DAiSEE dataset show the effectiveness of our method in comparison with the state-of-the-art automatic engagement recognition methods.
Year
DOI
Venue
2019
10.1109/SSCI44817.2019.9002713
2019 IEEE Symposium Series on Computational Intelligence (SSCI)
Keywords
Field
DocType
engagement recognition,spatiotemporal features,Convolutional 3D,class-imbalanced,Focal Loss
Computer science,Human–computer interaction,Artificial intelligence,Student engagement,Deep learning,Artificial neural network,Feature learning
Conference
ISBN
Citations 
PageRank 
978-1-7281-2486-5
0
0.34
References 
Authors
18
4
Name
Order
Citations
PageRank
Lin Geng100.34
Min Xu2184.41
Zeqiang Wei300.34
Xiuzhuang Zhou438020.26