MR Simulation for Re-wallpapering a Room in a Free-Hand Movie

This paper proposes a wallpaper replacement method in a free-hand movie. Our method superimposes computer graphics (CG) wallpaper onto a real wall region in the free-hand movie looking around a room. To extract wallpaper planes, ordinarily a special and expensive 3D survey instrument is required. However, there is usually no such instrument in homes or offices where many users want to experience wallpaper replacement simulation. To solve this problem, we extract the wallpaper region by an image segmentation technique with user interaction. By applying our method, wallpaper replacement can be easily achieved using only a handy camera and a PC.

[1]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[2]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[3]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[4]  Naokazu Yokoya,et al.  Interactive exploration of augmented aerial scenes with free-viewpoint image generation from pre-rendered images , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[5]  Pushmeet Kohli,et al.  Unwrap mosaics: a new representation for video editing , 2008, SIGGRAPH 2008.

[6]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[7]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[8]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[9]  Naokazu Yokoya,et al.  Real-time composition of stereo images for video see-through augmented reality , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[10]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[12]  Axel Pinz,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[13]  Yuichi Ohta,et al.  Mixed Reality: Merging Real and Virtual Worlds , 1999 .

[14]  Yun-Ta Tsai,et al.  Indirect augmented reality , 2011, Comput. Graph..

[15]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[16]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[17]  Stephen DiVerdi,et al.  All around the map: Online spherical panorama construction , 2009, Comput. Graph..

[18]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Richard Szeliski,et al.  Efficiently registering video into panoramic mosaics , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[21]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.