Title | ||
---|---|---|
Lecture2Note: Automatic Generation of Lecture Notes from Slide-Based Educational Videos |
Abstract | ||
---|---|---|
Given rapid development witnessed by open educational resources (OER) in the past few decades, a considerable number of online educational videos emerge on various MOOC platforms such as Coursera and YouTube. Nevertheless, most educational videos on the internet are lengthy and lack of elaborate annotations, which poses a challenge for learners to explore and locate content of interest efficiently. To address this, we present an automatic note-generating method to establish correspondences between visual entities in the slide-based lecture video and their descriptive speech texts by evaluating the semantic relationship. Firstly, the visual entities are extracted and recognised from the presentation slides. Then, each of visual entities is associated with its corresponding descriptive speech text. Finally, a placement optimisation scheme is put forward to pack the visual entities and speech texts into a note-like layout in a compact fashion, which can help learners to improve their learning efficiency. The experimental results show that the efficient performances about visual entity extraction and correspondence matching are efficient. The user study is also designed to investigate the performance of Lecture2Note in facilitating learning. Compared with peer methods, the auto-generated note created by our method achieves a higher user satisfaction level regarding a properly structured layout as well as efficient content navigation and exploration. |
Year | DOI | Venue |
---|---|---|
2019 | 10.1109/ICME.2019.00159 | 2019 IEEE International Conference on Multimedia and Expo (ICME) |
Keywords | DocType | ISSN |
Video navigation,Video summarisation,Slide processing,Visual-textual layout,Educational videos | Conference | 1945-7871 |
ISBN | Citations | PageRank |
978-1-5386-9553-1 | 0 | 0.34 |
References | Authors | |
0 | 7 |
Name | Order | Citations | PageRank |
---|---|---|---|
Chengpei Xu | 1 | 0 | 0.68 |
Ruomei Wang | 2 | 35 | 20.82 |
Shujin Lin | 3 | 77 | 7.74 |
Xiaonan Luo | 4 | 697 | 92.76 |
Baoquan Zhao | 5 | 5 | 3.16 |
Lijie Shao | 6 | 0 | 0.34 |
Mengqiu Hu | 7 | 93 | 3.56 |