Virtual view rendering using super-resolution with multiview images

This paper presents a new approach to solve the problem of quality degradation of a synthesized view, when a virtual camera moves forward. Interpolation techniques using only two neighboring views are generally applied when a virtual view is synthesized. Because the size of an object increases when the virtual camera moves forward, conventional methods have usually addressed this problem by interpolation techniques in order to synthesize a virtual view. However, as it generates a degraded view such as blurred images, we prevent a synthesized view from being blurred by using more images in multiview camera configuration. That is, this problem is solved by applying super-resolution concept which reconstructs a high resolution image from several low resolution images. Data fusion is performed by geometric warping with disparity maps of the multiple images followed by deblurring. Experimental results show that the image quality can further be improved by reducing blurring and halo effects in comparison with the interpolation method.

[1]  Ian D. Reid,et al.  Novel View Specification and Synthesis , 2002, BMVC.

[2]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[3]  Minglun Gong,et al.  Real-time backward disparity-based rendering for dynamic scenes using programmable graphics hardware , 2007, GI '07.

[4]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[5]  Takayuki Nagai,et al.  Simultaneous Estimation of Super-Resolved Image and 3D Information using Multiple Stereo-Pair Images , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Steven M. Seitz,et al.  Physically-valid view synthesis by image interpolation , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[7]  Toshiaki Fujii,et al.  View Generation with 3D Warping Using Depth Information for FTV , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[8]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[9]  Kiyoharu Aizawa,et al.  Reconstructing Dense Light Field From Array of Multifocus Images for Novel View Synthesis , 2007, IEEE Transactions on Image Processing.

[10]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[11]  Kwanghoon Sohn,et al.  2D/3D freeview video generation for 3DTV system , 2008, 2008 15th IEEE International Conference on Image Processing.

[12]  Thomas Sikora,et al.  Super-Resolution Stereo- and Multi-View Synthesis from Monocular Video Sequences , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[13]  Xin Li,et al.  Super-Resolution for Synthetic Zooming , 2006, EURASIP J. Adv. Signal Process..