Towards outdoor localization from GIS data and 3D content extracted from videos

We present an outdoor localization approach from videos and a 2D GIS (Geographic Information System). First, a 3D reconstruction as a cloud of points is done from the video with a Structure From Motion approach. Then a set of vertical planes is extracted from the cloud of points, using the presence of vanishing points in the video frames. This leads to a rough 3D model of the scene as a set of neighbor facades. That reconstruction will serve as an input data in a GIS localization query. Results of our reconstruction method are shown, based on a set of 27 videos of urban scenes.

[1]  Luc Van Gool,et al.  3D from Line Segments in Two Poorly-Textured, Uncalibrated Images , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[2]  Jan-Michael Frahm,et al.  Towards Urban 3D Reconstruction from Video , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[3]  Richard Szeliski,et al.  Manhattan-world stereo , 2009, CVPR.

[4]  Andrew Zisserman,et al.  Multi-view Matching for Unordered Image Sets, or "How Do I Organize My Holiday Snaps?" , 2002, ECCV.

[5]  Wei Zhang,et al.  Hierarchical building recognition , 2007, Image Vis. Comput..

[6]  Manolis I. A. Lourakis,et al.  The design and implementation of a generic sparse bundle adjustment software package based on the Le , 2004 .

[7]  Konrad Schindler,et al.  Towards Feature-Based Building Reconstruction from Images , 2003, WSCG.

[8]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization, Mapping and Moving Object Tracking , 2007, Int. J. Robotics Res..

[9]  Helmut Mayer,et al.  BUILDING FACADE INTERPRETATION FROM IMAGE SEQUENCES , 2005 .

[10]  Jana Kosecka,et al.  Detection and matching of rectilinear structures , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Antonio Criminisi,et al.  Single-View Metrology: Algorithms and Applications , 2002, DAGM-Symposium.

[12]  Myriam Servières,et al.  Pose computation based on Correspondence between 2D GIS and Street Images , 2009 .

[13]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[14]  Konrad Schindler,et al.  Piecewise planar scene reconstruction from sparse correspondences , 2006, Image Vis. Comput..

[15]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .