Exemplar-based Inpainting Using Superpixel Constraints for Interactive 3D Indoor Modeling

We have developed an interactive indoor modeler in which the user can create 3D indoor models from a single photo or multiple photos by simple interaction techniques based on computer vision principles. There are often invisible regions on some of the 3D planes since it is not easy to take a set of photos so that every region of the 3D models is included at least in one of those photos. We employ inpainting techniques for making up for the invisible regions with computer-generated texture patches and for merging the inpainted region with the neighboring visible regions . This paper describes a new inpainting technique that combines the Exemplar-based inpainting with the superpixel constraints in order to improve the structure propagation.

[1]  Marcel J. T. Reinders,et al.  Edge-based image restoration , 2005, IEEE Transactions on Image Processing.

[2]  Carsten Rother A new approach to vanishing point detection in architectural environments , 2002, Image Vis. Comput..

[3]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Chakarida Nukoolkit,et al.  Image shape representation using curve fitting , 2006 .

[5]  Assaf Zomet,et al.  Learning how to inpaint from global image statistics , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Jiaya Jia,et al.  Image completion with structure propagation , 2005, SIGGRAPH 2005.

[7]  Luigi Atzori,et al.  Reconstruction of missing or occluded contour segments using Bezier interpolations , 2000, Signal Process..

[8]  Tomoya Ishikawa,et al.  In-Situ 3D Indoor Modeler with a Camera and Self-contained Sensors , 2009, HCI.

[9]  Chi-Keung Tang,et al.  Image repairing: robust image synthesis by adaptive ND tensor voting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[12]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.

[13]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[14]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.

[15]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[16]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[17]  Tomoya Ishikawa,et al.  Service cooperation and co-creative intelligence cycles based on mixed-reality technology , 2010, 2010 8th IEEE International Conference on Industrial Informatics.

[18]  Yi-Chun Liao,et al.  Exemplar-based Image Inpainting base on Structure Construction , 2008, J. Softw..