A two tier approach to chalkboard video lecture summary

We present a new tool to help students make use of video recordings of traditional chalkboard and whiteboard lectures. Our tool provides a compact summary of a chalkboard lecture in the form of a set of slides, and an interactive environment for electronic note-taking in real time while watching a lecture in class or during review. Key to the processing of a chalkboard video by our system is the removal of the lecturer from the video (now no longer present to occlude the board) and segmentation of the resulting video to produce a set of slides comprising a compact presentation of the content written on the board during the lecture. Our method enhances learning in a number of ways. Students can focus on taking notes to supplement the material, rather than rote transcription. In addition, notes are aligned temporally with the lecture video and thus provide a useful way for students to index into the important parts of the video. Our system can be easily integrated into courses with a recorded lecture video component to help students organize their notes and quickly navigate the lectures from a given course for particular topics.

[1]  H. Maddox,et al.  Illustrating the lecture: Prepared diagrams vs. built-up diagrams , 1977 .

[2]  Christoph Meinel,et al.  An Automated Analysis and Indexing Framework for Lecture Video Portal , 2012, ICWL.

[3]  N. Amare.  To Slideware or Not to Slideware: Students' Experiences with Powerpoint Vs. Lecture , 2006 .

[4]  Frédo Durand,et al.  Visual transcripts , 2015, ACM Trans. Graph..

[5]  Frédéric Andrès,et al.  Towards Automated Lecture Capture, Navigation and Delivery System for Web-Lecture on Demand , 2010, ArXiv.

[6]  Adrian Ulges,et al.  AMIGO - automatic indexing of lecture footage , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[7]  Gaye Luna,et al.  Podcasting as Complement to Graduate Teaching: Does It Accommodate Adult Learning Theories? , 2011 .

[8]  Jennifer M. Apperson,et al.  The impact of presentation graphics on students' experience in the classroom , 2006, Comput. Educ..

[9]  Christoph Meinel,et al.  Automated Extraction of Lecture Outlines from Lecture Videos - A Hybrid Solution for Lecture Video Indexing , 2012, CSEDU.

[10]  Zicheng Liu,et al.  Why take notes? Use the whiteboard capture system , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[11]  Kenneth A. Kiewra.  A review of note-taking: The encoding-storage paradigm and beyond , 1989 .

[12]  Nikhilesh R Vaid.  Power corrupts: PowerPoint corrupts absolutely!: Part 1 , 2015 .

[13]  Laura R. Winer,et al.  The "Intelligent Classroom": changing teaching and learning with an evolving technological environment , 2002, Comput. Educ..

[14]  Monson H. Hayes,et al.  Audio-video based character recognition for handwritten mathematical content in classroom videos , 2014, Integr. Comput. Aided Eng..

[15]  Kasper Hornbæk,et al.  Video lectures : HCI and e-learning challenges , 2002 .

[16]  Chong-Wah Ngo,et al.  Synchronization of lecture videos and electronic slides by video text analysis , 2003, MULTIMEDIA '03.

[17]  Hsien-Chou Liao,et al.  An Automatic Lecture Recording System Using Pan-Tilt-Zoom Camera to Track Lecturer and Handwritten Data , 2015 .

[18]  Martha Driessnack.  A closer look at PowerPoint. , 2005, The Journal of nursing education.

[19]  Jay F. Nunamaker,et al.  Segmentation of lecture videos based on text: a method combining multiple linguistic features , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[20]  James D. Foley,et al.  Evaluating a Web Lecture Intervention in a Human–Computer Interaction Course , 2006, IEEE Transactions on Education.

[21]  Larry Bland,et al.  Applying Flip/Inverted Classroom Model In Electrical Engineering To Establish Life Long Learning , 2006 .

[22]  Candice Stefanou,et al.  Note-taking in the college classroom as evidence of generative learning , 2008 .

[23]  Timothy J Stelzer,et al.  Impact of multimedia learning modules on an introductory course on electricity and magnetism , 2010 .

[24]  Rakesh M. Verma,et al.  Topic based segmentation of classroom videos , 2015, 2015 IEEE Frontiers in Education Conference (FIE).

[25]  Andrew D. Katayama,et al.  Online Notes: Differential Effects of Studying Complete or Partial Graphically Organized Notes , 2003 .

[26]  Bonnie B. Armbruster.  Taking notes from lectures. , 2000 .

[27]  Tiecheng Liu,et al.  Summarization of Visual Content in Instructional Videos , 2007, IEEE Transactions on Multimedia.

[28]  John R. Kender,et al.  Lecture videos for e-learning: current research and challenges , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[29]  Attila Szabó,et al.  Using IT in the undergraduate classroom: should we replace the blackboard with PowerPoint? , 2000, Comput. Educ..

[30]  Ramon Cladellas Pros,et al.  Effects of the PowerPoint methodology on content learning , 2013 .

[31]  Matthew Kam,et al.  Livenotes: a system for cooperative and augmented note-taking in lectures , 2005, CHI.

[32]  Zhengyou Zhang,et al.  Real-Time Whiteboard Capture and Processing Using a Video Camera for Remote Collaboration , 2007, IEEE Transactions on Multimedia.

[33]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[34]  Harald Sack,et al.  Lecture Video Indexing and Analysis Using Video OCR Technology , 2011, 2011 Seventh International Conference on Signal Image Technology & Internet-Based Systems.