Simplifying video editing using metadata

Digital video is becoming increasingly ubiquitous. However, editing video remains difficult for several reasons: it is a time-based medium, it has dual tracks of audio and video, and current tools force users to work at the smallest level of detail. Based on interviews with professional video editors, we developed a video editor, called Silver, that uses metadata to make digital video editing more accessible to novices. To help users visualize video, Silver provides multiple views with different semantic content and at different levels of abstraction, including storyboard, editable transcript, and timeline views. Silver offers smart editing operations that help users resolve the inconsistencies that arise because of the different boundaries in audio and video. We conducted a preliminary user study to investigate the effectiveness of the Silver smart editing. Participants successfully edited video after only a short tutorial, both with and without smart editing assistance. Our research suggests several ways in which video editing tools could use metadata to assist users in the reuse and composition of video.

[1]  Takafumi Miyatake,et al.  Automatic scene separation and tree structure GUI for video editing , 1997, MULTIMEDIA '96.

[2]  Richard M. Stern,et al.  The 1996 Hub-4 Sphinx-3 System , 1997 .

[3]  Shingo Uchihashi,et al.  A semi-automatic approach to home video editing , 2000, UIST '00.

[4]  Takeo Kanade,et al.  Techniques for the Creation and Exploration of Digital Video Libraries , 1996 .

[5]  Amy Wohl,et al.  Apple computer, Inc. , 2003 .

[6]  Laura A. Dabbish,et al.  A multi-view intelligent editor for digital video libraries , 2001, JCDL '01.

[7]  Stephen W. Smoliar,et al.  Video parsing, retrieval and browsing: an integrated and content-based solution , 1997, MULTIMEDIA '95.

[8]  Alexander G. Hauptmann,et al.  Text, Speech, and Vision for Video Segmentation: The InformediaTM Project , 1995 .

[9]  Wendy E. Mackay,et al.  Virtual video editing in interactive multimedia applications , 1989, CACM.

[10]  Yihong Gong,et al.  Lessons Learned from Building a Terabyte Digital Video Library , 1999, Computer.

[11]  Shingo Uchihashi,et al.  An interactive comic book presentation for exploring video , 2000, CHI.

[12]  Thomas D. C. Little,et al.  Automatic Composition Techniques for Video Production , 1998, IEEE Trans. Knowl. Data Eng..

[13]  Howard D. Wactlar,et al.  Informedia: improving access to digital video , 1994, INTR.

[14]  Akio Nagasaka,et al.  Automatic structure visualization for video editing , 1993, INTERCHI.

[15]  Glorianna Davenport,et al.  Cinematic primitives for multimedia , 1991, IEEE Computer Graphics and Applications.

[16]  John M. Gauch,et al.  The vision digital video library , 1997, Inf. Process. Manag..

[17]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[18]  Tat-Seng Chua,et al.  A video retrieval and sequencing system , 1995, TOIS.

[19]  Frank M. Shipman,et al.  Home Video Editing Made Easy - Balancing Automation and User Control , 2001, INTERACT.