Content and Context Boosting for Mobile Landmark Recognition

Existing mobile landmark recognition techniques mainly use GPS location information to obtain the candidate images nearby the mobile device, followed by content analysis within the shortlist. This is insufficient since i) GPS often has large errors in dense build-up areas, and ii) direction is underutilized to further improve recognition. In this letter, visual content and two types of mobile context: location and direction, are integrated by the proposed boosting algorithm. Experimental results show that the proposed method outperforms the state-of-the-art methods by about 6%, 11%, and 15% on NTU Landmark-50, PKU Landmark-198, and the large-scale San Francisco landmark dataset, respectively.

[1]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[2]  Bernd Girod,et al.  Mobile Visual Search , 2011, IEEE Signal Processing Magazine.

[3]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[4]  Wen Gao,et al.  PKUBench: A context rich mobile visual search benchmark , 2011, 2011 18th IEEE International Conference on Image Processing.

[5]  Xin Chen,et al.  City-scale landmark identification on mobile devices , 2011, CVPR 2011.

[6]  Joo-Hwee Lim,et al.  Scene Recognition with Camera Phones for Tourist Information Access , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[7]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[8]  Zhen Li,et al.  A Comparative Study of Mobile-Based Landmark Recognition Techniques , 2010, IEEE Intelligent Systems.

[9]  Trevor Hastie,et al.  Multi-class AdaBoost ∗ , 2009 .

[10]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Tao Chen,et al.  A multi-scale learning approach for landmark recognition using mobile devices , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[12]  Lucas Paletta,et al.  A Mobile Vision System for Urban Detection with Informative Local Descriptors , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[13]  Daniel P. Huttenlocher,et al.  Landmark classification in large-scale image collections , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.