AMIGO: accurate mobile image geotagging

With location-based services gaining popularity among mobile users, researchers are exploring the way using the phone-captured image for localization as it contains more context information than the embedded sensory GPS coordinates. We present in this paper a novel mobile image geotagging approach to accurately sense the actual geo-context of a mobile user. The proposed approach, named AMIGO (Accurate Mobile Image GeOtagging), is able to provide a comprehensive set of accurate geo-context based on the current image and its associated scene in the database. The geo-context includes the real locations of a mobile user and the scene, the viewing angle, and the distance between the user and the scene. Specifically, we first perform partial duplicate image retrieval to select crowdsourced images capturing the same scene as the query image. We then employ the structure-from-motion technique to reconstruct a sparse 3D point cloud of the scene. Finally, by projecting the reconstructed scene onto the horizontal plane, we can derive user's location, viewing angle, and distance. The effectiveness of AMIGO has been validated by experimental results.

[1]  Qi Tian,et al.  Spatial coding for large scale partial-duplicate web image search , 2010, ACM Multimedia.

[2]  Jiebo Luo,et al.  Geo-location inference from image content and user tags , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  Rongrong Ji,et al.  Active query sensing for mobile location search , 2011, ACM Multimedia.

[5]  Jiebo Luo,et al.  Beyond GPS: determining the camera viewing direction of a geotagged image , 2010, ACM Multimedia.

[6]  Tat-Seng Chua,et al.  Estimating Poses of World's Photos with Geographic Metadata , 2010, MMM.

[7]  Alexei A. Efros,et al.  IM2GPS: estimating geographic information from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Tao Mei,et al.  When recommendation meets mobile: contextual and personalized recommendation on the go , 2011, UbiComp '11.

[9]  Anas Al-Nuaimi,et al.  Mobile Visual Location Recognition , 2013 .

[10]  Xin Chen,et al.  City-scale landmark identification on mobile devices , 2011, CVPR 2011.

[11]  Yanxi Liu,et al.  Detecting and matching repeated patterns for automatic geo-tagging in urban environments , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..