Importance of Feature Locations in Bag-of-Words Image Classification

The impact of image feature locations in the bag-of-words model for object classification is examined. It is demonstrated that a simple variance-based method works well and offers advantages over several other methods. In essence, the feature locations are selected intelligently, decreasing the redundancy and cost sometimes associated with feature extraction on dense grids. Classification results on two databases are presented, using a support vector machine classifier.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[3]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[5]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[6]  Andrew Zisserman,et al.  Classifying Images of Materials: Achieving Viewpoint and Illumination Independence , 2002, ECCV.

[7]  Michael I. Jordan,et al.  Probabilistic models of text and images , 2004 .

[8]  Andrew Zisserman,et al.  Efficient Visual Content Retrieval and Mining in Videos , 2004, PCM.

[9]  Andrew Zisserman,et al.  Scene Classification Via pLSA , 2006, ECCV.

[10]  David A. Forsyth,et al.  The effects of segmentation and feature choice in a translation model of object recognition , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[13]  Antonio Criminisi,et al.  Object categorization by learned universal visual dictionary , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[15]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[16]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[17]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.