Proscenium: a framework for spatio-temporal video editing

We present an approach to video editing where movie sequences are treated as spatio-temporal volumes that can be sheered and warped under user control. This simple capability enables new video editing operations that support complex postproduction modifications, such as object removal and/or changes in camera motion. Our methods do not rely on complicated and error-prone image analysis or computer vision methods. Moreover, they facilitate an editing approach to video that is similar to standard image-editing tasks. Central to our system is a movie representation framework called Proscenium that supports efficient queries and operations on spatio-temporal volumes while maintaining the original source content. We have adopted a graph-based lazy-evaluation model in order to support interactive visualizations, complex data modifications, and efficient processing of large spatio-temporal volumes.

[1]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[2]  George Wolberg,et al.  Digital image warping , 1990 .

[3]  Sidney Fels,et al.  Techniques for Interactive Video Cubism , 2000 .

[4]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[5]  William K. Pratt,et al.  Developing Visual Applications: Xil : An Imaging Foundation Library , 1997 .

[6]  Adam Finkelstein,et al.  Stylized video cubes , 2002, SCA '02.

[7]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[8]  David Salesin,et al.  Video matting of complex scenes , 2002, SIGGRAPH.

[9]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[10]  Sidney S. Fels,et al.  Techniques for interactive video cubism (poster session) , 2000, ACM Multimedia.

[11]  Edward H. Adelson,et al.  Layered representation for motion analysis , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Matthias Zwicker,et al.  Pointshop 3D: an interactive system for point-based surface editing , 2002, SIGGRAPH.

[13]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[14]  Peter-Pike J. Sloan,et al.  Video Cubism , 2001 .

[15]  Lawrence A. Rowe,et al.  Design and performance of the Berkeley Continuous Media Toolkit , 1997, Electronic Imaging.

[16]  Michael Bosse,et al.  Non-metric image-based rendering for video stabilization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .