Topic-based playlist to improve video lecture accessibility

Learning is considered one of the most important activities for the human being, and many educational institutes are trying to improve the engagement with students through the availability of video lectures. However, the access to video material is not easy as one may think. For millions of people with some form of disabilities the simple act of browsing a video lecture archive represents an insuperable burden. Motivated by the need to improve accessibility to video lecture materials, in this paper we present VLP, which stands for Video Lecture Playlist. The idea is to use low-level audio/video features, video segmentation and OCR analysis to “understand” the content of the video lectures. In this way, students can search for specific topic through keywords and the system browses the entire video lecture archive to find all the pieces of video lectures that cover the searched topic. These pieces are then provided through a playlist, so that a single search and a single playout return a complete view of how the searched topic is covered within the entire archive. A developed prototype shows the feasibility of the approach and results obtained from a survey highlight that students would like to browse video lecture archives with keywords and playlists.

[1]  Christoph Meinel,et al.  Content Based Lecture Video Retrieval Using Speech and Video Text Information , 2014, IEEE Transactions on Learning Technologies.

[2]  Marco Furini,et al.  Enhancing learning accessibility through fully automatic captioning , 2012, W4A.

[3]  Ian N. Toppin.  Video lecture capture (VLC) system: A comparison of student versus faculty perceptions , 2011, Education and Information Technologies.

[4]  Dunja Mladenic,et al.  Semi-automatic Categorization of Videos on VideoLectures.net , 2009, ECML/PKDD.

[5]  John R. Kender,et al.  Lecture videos for e-learning: current research and challenges , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[6]  Sang-Kyun Kim,et al.  An Effective News Anchorperson Shot Detection Method Based on Adaptive Audio/Visual Model Generation , 2005, CIVR.

[7]  Marco Furini,et al.  Secure, Portable, and Customizable Video Lectures for E-learning on the Move , 2009, Informatica.

[8]  Christoph Meinel,et al.  Lecture video segmentation by automatically analyzing the synchronized slides , 2013, ACM Multimedia.

[9]  Chong-Wah Ngo,et al.  Structuring low-quality videotaped lectures for cross-reference browsing by video text analysis , 2008, Pattern Recognit..

[10]  Silvia Mirri,et al.  On using on-the-fly students' notes in video lecture indexing , 2017, 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[11]  Christoph Meinel,et al.  Browsing within Lecture Videos Based on the Chain Index of Speech Transcription , 2008, IEEE Transactions on Learning Technologies.

[12]  Azzam Sleit,et al.  Video PowerSearcher: a text-based indexing e-learning system , 2010, ISWSA '10.

[13]  Sridhar Iyer,et al.  Automated Tagging to Enable Fine-Grained Browsing of Lecture Videos , 2011, 2011 IEEE International Conference on Technology for Education.

[14]  Jaspal Subhlok,et al.  Indexing and keyword search to ease navigation in lecture videos , 2011, 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[15]  Marco Furini,et al.  On introducing timed tag-clouds in video lectures indexing , 2016, Multimedia Tools and Applications.

[16]  Marco Furini.  On gamifying the transcription of digital video lectures , 2016, Entertain. Comput..

[17]  Marco Furini,et al.  Bringing multimedia contents into MP3 files , 2005, IEEE Communications Magazine.

[18]  Marco Furini,et al.  An automatic caption alignment mechanism for off-the-shelf speech recognition technologies , 2012, Multimedia Tools and Applications.

[19]  Marco Furini,et al.  Fast play: a novel feature for digital consumer video devices , 2008, IEEE Transactions on Consumer Electronics.

[20]  Myoung-Ho Kim,et al.  An accurate lecture video segmentation method by using sift and adaptive threshold , 2012, MoMM '12.

[21]  Weiyu Zhu,et al.  Automatic news video segmentation and categorization based on closed-captioned text , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[22]  Paola Salomoni,et al.  Augment browsing and standard profiling for enhancing web accessibility , 2011, W4A.

[23]  Marco Roccetti,et al.  Profiling learners with special needs for custom e-learning experiences, a closed case? , 2007, W4A '07.

[24]  M. Pellegrini,et al.  On Using Clustering Algorithms to Produce Video Abstracts for the Web Scenario , 2008, 2008 5th IEEE Consumer Communications and Networking Conference.

[25]  W. Richards Adrion,et al.  Student reactions to classroom lecture capture , 2012, ITiCSE '12.

[26]  Silvia Mirri,et al.  TagLecture: The gamification of video lecture indexing through quality-based tags , 2017, 2017 IEEE Symposium on Computers and Communications (ISCC).

[27]  Marco Roccetti,et al.  A multimedia broker to support accessible and mobile learning through learning objects adaptation , 2008, TOIT.

[28]  Frédo Durand,et al.  Visual transcripts , 2015, ACM Trans. Graph..