Title
Lecture2Note: Automatic Generation of Lecture Notes from Slide-Based Educational Videos
Abstract
Given rapid development witnessed by open educational resources (OER) in the past few decades, a considerable number of online educational videos emerge on various MOOC platforms such as Coursera and YouTube. Nevertheless, most educational videos on the internet are lengthy and lack of elaborate annotations, which poses a challenge for learners to explore and locate content of interest efficiently. To address this, we present an automatic note-generating method to establish correspondences between visual entities in the slide-based lecture video and their descriptive speech texts by evaluating the semantic relationship. Firstly, the visual entities are extracted and recognised from the presentation slides. Then, each of visual entities is associated with its corresponding descriptive speech text. Finally, a placement optimisation scheme is put forward to pack the visual entities and speech texts into a note-like layout in a compact fashion, which can help learners to improve their learning efficiency. The experimental results show that the efficient performances about visual entity extraction and correspondence matching are efficient. The user study is also designed to investigate the performance of Lecture2Note in facilitating learning. Compared with peer methods, the auto-generated note created by our method achieves a higher user satisfaction level regarding a properly structured layout as well as efficient content navigation and exploration.
Year
DOI
Venue
2019
10.1109/ICME.2019.00159
2019 IEEE International Conference on Multimedia and Expo (ICME)
Keywords
DocType
ISSN
Video navigation,Video summarisation,Slide processing,Visual-textual layout,Educational videos
Conference
1945-7871
ISBN
Citations 
PageRank 
978-1-5386-9553-1
0
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
Chengpei Xu100.68
Ruomei Wang23520.82
Shujin Lin3777.74
Xiaonan Luo469792.76
Baoquan Zhao553.16
Lijie Shao600.34
Mengqiu Hu7933.56