OpenTrack - Automated Camera Control for Lecture Recordings

In this paper we present the current state of our research project which aims to develop an open-source framework for real-time scene analysis and automatic camera control in lecture recording scenarios. The system is designed to run in alliance with the Opencast Matter horn lecture capture system as well as stand-alone. A GPU-based scene segmentation technique using motion cues and background modeling has been implemented using OpenCL. Moving objects are tracked by their centroids and bounding boxes and a dynamic appearance model is used to give persons a relative identity. Development started on a scriptable virtual camera operator module that will drive PTZ-cameras. Other applications of the scene analysis are possible.

[1]  Michael N. Wallick,et al.  A framework for virtual videography , 2002, SMARTGRAPH '02.

[2]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.

[3]  Anoop Gupta,et al.  Building an intelligent camera management system , 2001, MULTIMEDIA '01.

[4]  Janne Heikkilä,et al.  A real-time system for monitoring of cyclists and pedestrians , 2004, Image Vis. Comput..

[5]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Karsten Morisse,et al.  User Generated Web Lecture Snippets to Support a Blended Learning Approach , 2009 .

[7]  Stephen J. Maybank,et al.  The ADVISOR Visual Surveillance System , 2004 .

[8]  Anoop Gupta,et al.  Videography for telepresentations , 2003, CHI '03.

[9]  Markus Ketterl,et al.  Opencast Matterhorn: A community-driven open source software project for producing, managing, and distributing academic video , 2010, Interact. Technol. Smart Educ..

[10]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[11]  Anoop Gupta,et al.  Automating camera management for lecture room environments , 2001, CHI.

[12]  Oliver Vornberger,et al.  The virtPresenter lecture recording system: Automated production of web lectures with interactive content overviews , 2007, Interact. Technol. Smart Educ..

[13]  Steven M. Drucker,et al.  CamDroid: a system for implementing intelligent camera control , 1995, I3D '95.

[14]  Michael Bianchi.  Automatic video production of lectures using an intelligent and aware environment , 2004, MUM '04.

[15]  Ralf Schneider,et al.  Connected component labeling on a 2D grid using CUDA , 2011, J. Parallel Distributed Comput..

[16]  Alan M. McIvor,et al.  Background Subtraction Techniques , 2000 .