Image inpainting based on scene transform and color transfer

In this paper, an image inpainting algorithm named stct-inpainting is proposed based on scene transform and color transfer. At first, a source image, which wears the most similar appearance to the damaged image, is searched from the image database by comparing with the features like texture, color and structural information. Then, scene filling in damaged region is completed by selecting appropriate object from the source image. After that, a cost function is employed to tackle the boundary line of the inpainted region and a color transfer algorithm is finally used to make the color appearance of the inpainted region be in harmony with that of its surroundings. Experimental results demonstrate that our developed algorithm is comparable with the state-of-art scene-completion algorithm proposed by Hays.

[1]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[2]  Richard C. Dubes,et al.  Performance evaluation for four classes of textural features , 1992, Pattern Recognit..

[3]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[4]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[8]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[9]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[10]  Roberto Cipolla,et al.  Hole Filling Through Photomontage , 2005, BMVC.

[11]  Hong Li,et al.  Selective color transfer with multi-source images , 2009, Pattern Recognit. Lett..

[12]  Eli Shechtman,et al.  Space-time video completion , 2004, CVPR 2004.

[13]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[14]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[15]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2007, SIGGRAPH 2007.

[16]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..