3D ordinal constraint in spatial configuration for robust scene recognition

This paper proposes a scene recognition strategy that integrates the appearance based local SURF features and the geometry based 3D ordinal constraint. Firstly, we show that spatial ordinal ranks of 3D landmarks are well correlated across large camera viewpoint and view direction changes and thus serve as a powerful tool for scene recognition. Secondly, ordinal depth information is acquired in a simple and robust manner when the camera undergoes a bio-mimic `turn-back-and-look¿(TBL) motion. Thirdly, a scene recognition strategy is proposed by combining local SURF feature matches and global 3D rank correlation coefficient into the scene recognition decision process. The performance is validated and evaluated over four indoor and outdoor databases.

[1]  JainRamesh,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000 .

[2]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[3]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[4]  James J. Little,et al.  Vision-based mobile robot localization and mapping using scale-invariant features , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  Loong Fah Cheong,et al.  Characterizing Depth Distortion under Different Generic Motions , 2004, International Journal of Computer Vision.

[7]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[8]  R. Forthofer,et al.  Rank Correlation Methods , 1981 .

[9]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[10]  J. Zeil,et al.  Active vision in insects: an analysis of object-directed zig-zag flights in wasps (Odynerus spinipes , Eumenidae) , 1998, Journal of Comparative Physiology A.

[11]  Mario E. Munich,et al.  Enforcing 3D Constraints To Improve Object and Scene Recognition , 2007, BMVC.

[12]  Jean Ponce,et al.  Local, semi-local and global models for texture, object and scene recognition , 2006 .

[13]  Gustavo Carneiro,et al.  Flexible Spatial Configuration of Local Image Features , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.