Image clusters based 3D virtual tour schema

This paper presents a 3D virtual tour schema based on image clusters. With the development of the Internet, various image-based applications have generated large amounts of image data. Vast amounts of image data can be effectively organized by clustering algorithms according to their geographic location information and content, thus forming image clusters. These data then can be reconstructed for 3D virtual tour using the state-of-the-art computer vision methods. This paper analyzes the popular photo tours application and Photosynth, and proposes an image clusters based 3D virtual tour schema on the basis of these applications. This paper also points out the room for improvement in the future, and several possible applications based on this schema are discussed finally.

[1]  Steven M. Seitz,et al.  Finding paths through the world's photos , 2008, SIGGRAPH 2008.

[2]  Steven M. Seitz,et al.  Photo Tours , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[3]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[4]  Shuhan Shen,et al.  Depth-map merging for Multi-View Stereo with high resolution images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[5]  Jean-Philippe Pons,et al.  Towards high-resolution large-scale multi-view stereo , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[7]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[8]  Harry Shum,et al.  Review of image-based rendering techniques , 2000, Visual Communications and Image Processing.

[9]  Jon M. Kleinberg,et al.  Mapping the world's photos , 2009, WWW '09.

[10]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Carsten Rother,et al.  PatchMatch Stereo - Stereo Matching with Slanted Support Windows , 2011, BMVC.

[12]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Tat-Seng Chua,et al.  Tour the world: Building a web-scale landmark recognition engine , 2009, CVPR.

[14]  Mohan S. Kankanhalli,et al.  Proceedings of the 2008 international conference on Content-based image and video retrieval , 2008 .

[15]  Pascal Fua,et al.  Efficient large-scale multi-view stereo for ultra high-resolution image sets , 2011, Machine Vision and Applications.

[16]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[17]  Luc Van Gool,et al.  World-scale mining of objects and events from community photo collections , 2008, CIVR '08.

[18]  Andrew Owens,et al.  Discrete-continuous optimization for large-scale structure from motion , 2011, CVPR 2011.

[19]  Richard Szeliski,et al.  Manhattan-world stereo , 2009, CVPR.