A video editing system based on the depth information

In this paper, we propose a method to measure the distance between the camera and object of the scene. In our method, first we calculate the distance between the camera and the scene, and then measure the depth of the objects of the scene. The measurement of depth needs some information from camera, so we use the two symmetric frames to calculate the parameters of camera. In the second step, to remove radial and lens distortion, third, to rectify the input images, finally, use the block-matching stereo algorithm and graph cut-based algorithm with SAD to find the disparity. When we finish the measurement of depth of the background in the video, we can use the information to implant the objects and adjust their size automatically.

[1]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[2]  Jiang Yu Zheng,et al.  A slit scanning depth of route panorama from stationary blur , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Philippe Bekaert,et al.  Local Stereo Matching with Segmentation-based Outlier Rejection , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[4]  Jian Sun,et al.  Drag-and-drop pasting , 2006, SIGGRAPH 2006.

[5]  Ashutosh Saxena,et al.  Make3D: Depth Perception from a Single Still Image , 2008, AAAI.

[6]  Timothy K. Shih,et al.  Luminance Adjustment in Image and Video , 2008, PCM.

[7]  Ashutosh Saxena,et al.  Depth Estimation Using Monocular and Stereo Cues , 2007, IJCAI.

[8]  Jian Sun,et al.  Symmetric stereo matching for occlusion handling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Timothy K. Shih,et al.  The Development of Image-based Distance Measurement System , 2009 .

[10]  Zhi-Gang Zheng,et al.  A region based stereo matching algorithm using cooperative optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Antonio Criminisi,et al.  Single-View Metrology: Algorithms and Applications , 2002, DAGM-Symposium.

[13]  Hujun Bao,et al.  Recovering consistent video depth maps via bundle optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Xiaochun Cao,et al.  Metrology in uncalibrated images given one vanishing point , 2005, IEEE International Conference on Image Processing 2005.

[15]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[16]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[17]  H. Opower.  Multiple view geometry in computer vision , 2002 .