View Morphing Based on Auto-calibration for Generation of In-between Views

Since image morphing methods do not account for changes in viewpoint or object pose, it may be difficult even to express simple 3D transformations. Although previous view morphing can synthesize change in viewpoint, it requires camera viewpoints for automatic generation of in-between views and control points by user input for post-warping. This paper presents a new morphing algorithm that can generate automatically in-between scenes by using auto-calibration. Our method rectifies two images based on the fundamental matrix, and computes a morph that is linear interpolation with a bilinear disparity map, then generates in-between views. The proposed method has an advantage that knowledge of 3D shape and camera settings is unnecessary.

[1]  Aaron F. Bobick,et al.  Disparity-Space Images and Large Occlusion Stereo , 1994, ECCV.

[2]  Aggelos K. Katsaggelos,et al.  Dense Disparity Estimation with a Divide-and-Conquer Disparity Space Image Technique , 1999, IEEE Trans. Multim..

[3]  Charles T. Loop,et al.  Computing rectifying homographies for stereo vision , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[5]  Xiaoyong Sun,et al.  A method for the synthesis of intermediate views in image-based rendering using image rectification , 2002, IEEE CCECE2002. Canadian Conference on Electrical and Computer Engineering. Conference Proceedings (Cat. No.02CH37373).

[6]  Daniel Scharstein,et al.  Stereo vision for view synthesis , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[8]  Charles R. Dyer,et al.  Interpolating view and scene motion by dynamic view morphing , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[9]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[10]  Avideh Zakhor,et al.  View generation for three-dimensional scenes from video sequences , 1997, IEEE Trans. Image Process..

[11]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Yi-Ping Hung,et al.  Disparity-based view morphing—a new technique for image-based rendering , 1998, VRST '98.

[13]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.