Virtual videography

Well-produced videos provide a convenient and effective way to archive lectures. In this article, we offer a new way to create lecture videos that retains many of the advantages of well-composed recordings, without the cost and intrusion of a video production crew. We present an automated system called Virtual Videography that employs the art of videography to mimic videographer-produced videos, while unobtrusively recording lectures. The system uses the data recorded by unattended video cameras and microphones to produce a new edited video as an offline postprocess. By producing videos offline, our system can use future information when planning shot sequences and synthesizing new shots. Using simple syntactic cues gathered from the original video and a novel shot planning algorithm, the system makes cinematic decisions without any semantic understanding of the lecture.

[1]  Michael N. Wallick,et al.  A framework for virtual videography , 2002, SMARTGRAPH '02.

[2]  Steven M. Drucker,et al.  CamDroid: a system for implementing intelligent camera control , 1995, I3D '95.

[3]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[4]  Kunio Fukunaga,et al.  Production of video images by computer controlled cameras and its application to TV conference system , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Tanveer F. Syeda-Mahmood,et al.  Detecting topical events in digital video , 2000, ACM Multimedia.

[6]  John R. Kender,et al.  Spatial-Temporal Semantic Grouping of Instructional Video Content , 2003, CIVR.

[7]  David Bordwell,et al.  On the history of film style , 1997 .

[8]  Berna Erol,et al.  Portable meeting recorder , 2002, MULTIMEDIA '02.

[9]  Zicheng Liu,et al.  Why take notes? Use the whiteboard capture system , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[10]  Milton Chen,et al.  Design of a virtual auditorium , 2001, MULTIMEDIA '01.

[11]  Richard E. Clark,et al.  When researchers swim upstream: reflections on an unpopular argument about learning from media , 1991 .

[12]  Daniel M. Russell.  A design pattern-based video summarization technique: moving from low-level signals to high-level structure , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[13]  Anoop Gupta,et al.  Building an intelligent camera management system , 2001, MULTIMEDIA '01.

[14]  Susan Howard,et al.  Shot by Shot: A Practical Guide to Filmmaking , 1993 .

[15]  Michael Gleicher,et al.  Towards virtual videography (poster session) , 2000, ACM Multimedia.

[16]  Yong Rui,et al.  A portable solution for automatic lecture room camera management , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[17]  Walter Bender,et al.  Salient video stills: content and context preserved , 1993, MULTIMEDIA '93.

[18]  Shingo Uchihashi,et al.  A semi-automatic approach to home video editing , 2000, UIST '00.

[19]  Michael Gleicher,et al.  Virtual videography , 2006, MM '06.

[20]  Jane Hunter,et al.  A streamlined system for building online presentation archives using SMIL , 2000, ACSE '00.

[21]  Anoop Gupta,et al.  Distributed meetings: a meeting capture and broadcasting system , 2002, MULTIMEDIA '02.

[22]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.

[23]  Kunio Fukunaga,et al.  Blackboard segmentation using video image of lecture and its applications , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[24]  Frank M. Shipman,et al.  Home Video Editing Made Easy - Balancing Automation and User Control , 2001, INTERACT.

[25]  Michael Bianchi.  Automatic video production of lectures using an intelligent and aware environment , 2004, MUM '04.

[26]  Diane Harley,et al.  BIBS: A Lecture Webcasting System , 2001 .

[27]  Claudio S. Pinhanez,et al.  Intelligent Studios: Using Computer Vision to Control TV Cameras , 1995 .

[28]  Gregory D. Abowd,et al.  Classroom 2000: An Experiment with the Instrumentation of a Living Educational Environment , 1999, IBM Syst. J..

[29]  Arnd A. Steinmetz,et al.  e-Seminar lecture recording and distribution system , 2000, IS&T/SPIE Electronic Imaging.

[30]  Anoop Gupta,et al.  Auto-summarization of audio-video presentations , 1999, MULTIMEDIA '99.

[31]  Ying Li,et al.  An Overview of Video Abstraction Techniques , 2001 .

[32]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[33]  Brian Christopher Smith,et al.  Passive capture and structuring of lectures , 1999, MULTIMEDIA '99.

[34]  James C. Lester,et al.  Intelligent multi-shot visualization interfaces for dynamic 3D worlds , 1998, IUI '99.

[35]  Chong-Wah Ngo,et al.  Gesture tracking and recognition for lecture video editing , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[36]  Joan E. Hart,et al.  Film Directing Shot by Shot: Visualizing from Concept to Screen , 1991 .

[37]  Lawrence A. Rowe,et al.  Virtual director: automating a webcast , 2001, IS&T/SPIE Electronic Imaging.

[38]  R. Clark.  Reconsidering Research on Learning from Media , 1983 .

[39]  Steven K. Feiner,et al.  Automated presentation planning of animation using task decomposition with heuristic reasoning , 1993 .

[40]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[41]  Newton Lee,et al.  ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMCCAP) , 2007, CIE.