Diminished reality considering background structures

This paper proposes a new diminished reality method for 3D scenes considering background structures. Most conventional methods using image inpainting assumes that the background around a target object is almost planar. In this study, approximating the background structure by the combination of local planes, perspective distortion of texture is corrected and searching area is limited for improving the quality of image inpainting. The temporal coherence of texture is preserved using the estimated structures and camera pose estimated by Visual-SLAM.

[1]  Naokazu Yokoya,et al.  Image inpainting considering symmetric patterns , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[2]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[3]  Naokazu Yokoya,et al.  AR marker hiding based on image inpainting and reflection of illumination changes , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[4]  Wolfgang Broll,et al.  Advanced self-contained object removal for realizing real-time Diminished Reality in unconstrained environments , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[5]  Wolfgang Broll,et al.  PixMix: A real-time approach to high-quality Diminished Reality , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[6]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.