An approach to 2D-To-3D conversion for multiview displays

This paper proposes an approach for 2D-to-3D conversion for multiview displays. It employs an object-based approach where objects at large depth differences are first segmented by semi-automatic tools. Appropriate depth values are assigned to these objects and the missing image pixels at the background are filled in by inpainting techniques so that different views of the image can be synthesized. This approach helps to shorten the process of 2D-to-3D conversion and its performance is satisfactory for images and short video clips.

[1]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[2]  Wen Gao,et al.  2D to 3D convertion based on edge defocus and segmentation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Neil A. Dodgson,et al.  Integrating procedural textures with replicated image editing , 2005, GRAPHITE '05.

[4]  Assaf Zomet,et al.  Learning how to inpaint from global image statistics , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Guillermo Sapiro,et al.  Filling-in by joint interpolation of vector fields and gray levels , 2001, IEEE Trans. Image Process..

[6]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[7]  M. Halle,et al.  3-D Displays and Signal Processing , 2007, IEEE Signal Processing Magazine.

[8]  Harry Shum,et al.  A Joint Motion-Image Inpainting Method for Error Concealment in Video Coding , 2006, 2006 International Conference on Image Processing.

[9]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[10]  Andrea Fusiello.  Image-based Rendering * , 2003 .

[11]  Heung-Yeung Shum,et al.  Image-Based Rendering and Synthesis , 2007, IEEE Signal Processing Magazine.

[12]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[13]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[14]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[15]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[16]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[17]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[19]  Lucas Pereira,et al.  Image replacement through texture synthesis , 1997, Proceedings of International Conference on Image Processing.

[20]  Liang-Gee Chen,et al.  Depth Map Generation for 2D-to-3D Conversion by Short-Term Motion Assisted Color Segmentation , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[21]  Harry Shum,et al.  Lazy snapping , 2004, ACM Trans. Graph..

[22]  Harry Shum,et al.  Image-based rendering , 2006, Found. Trends Comput. Graph. Vis..

[23]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .