Forward-view transition algorithm between the near and the far views and its extension to the panoramic images

We propose a new algorithm that generates intermediate scenes from the near and the far views. Assuming that two cameras can be approximated with the affine model, we align the optical axes of the near and the far views on the transition baseline using the Fourier method. Then we determine the scale of the desired novel scene, zoom in the far view, and zoom out the near view. The zoom-in far view is theoretically the same as the zoom-out near view, but disparities exist that cause the synthesized image to present the double-blurring effect. Therefore, we remove the disparities of the zoom-out near view and then synthesize it with the zoom-in far view. For the panorama-based navigation system, the proposed algorithm can also generate images having smooth and realistic transitions as the viewer walks from the current panoramic image to the next panoramic image.

[1]  Luiz Velho,et al.  Image Processing for Computer Graphics , 1997, Springer New York.

[2]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[3]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[4]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[5]  Jeffrey S. McVeigh,et al.  Intermediate view synthesis considering occluded and ambiguously referenced image regions , 1996, Signal Process. Image Commun..

[6]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[7]  Yuichi Ohta,et al.  3D image display with motion parallax by camera matrix stereo , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[8]  Yi-Ping Hung,et al.  Disparity-based view morphing—a new technique for image-based rendering , 1998, VRST '98.

[9]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[10]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[11]  Ken-ichi Anjyo,et al.  Tour Into the Picture using a Vanishing Line and its Extension to Panoramic Images , 2001, Comput. Graph. Forum.

[12]  Amnon Shashua,et al.  Novel View Synthesis by Cascading Trilinear Tensors , 1998, IEEE Trans. Vis. Comput. Graph..

[13]  Yong-In Yoon,et al.  An efficient method to build panoramic image mosaics , 2003, Pattern Recognit. Lett..

[14]  Sung Yong Shin,et al.  Tour into the video: image-based navigation scheme for video sequences of dynamic scenes , 2002, VRST '02.