A new pyramid-based color image representation for visual localization

This paper presents a new algorithm to extract a color graph from a real image so that it can be efficiently represented in a compact way. The proposal presents two main novelties. First, a new PCA-based color feature vector has been defined. This vector is resistant against illumination changes, noise and microtextures. Second, the image is segmented by means of a fast, hierarchical split and merge algorithm based on a pyramid structure that implicitly provides a color graph. In order to test the suitability of the proposed representation technique, simple localization experiments have been conducted in different real environments.

[1]  S. Sclaroff,et al.  ImageRover: a content-based image browser for the World Wide Web , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[2]  Gregory Dudek,et al.  Comparing image-based localization methods , 2003, IJCAI.

[3]  Michael Spann,et al.  Image segmentation using a dynamic thresholding pyramid , 1989, Pattern Recognit..

[4]  Ben J. A. Kröse,et al.  Active Appearance-Based Robot Localization Using Stereo Vision , 2005, Auton. Robots.

[5]  Mohamad H. Hassoun,et al.  A Weighted Voting and Sequential Combination of Classifiers Scheme for Human Face Recognition , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[6]  Wolfram Burgard,et al.  Using an Image Retrieval System for Vision-Based Mobile Robot Localization , 2002, CIVR.

[7]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[8]  Ben J. A. Kröse,et al.  Probabilistic localization by appearance models and active vision , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[9]  Michael J. Swain,et al.  WebSeer: An Image Search Engine for the World Wide Web , 1996 .

[10]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Azriel Rosenfeld,et al.  Segmentation and Estimation of Image Region Properties through Cooperative Hierarchial Computation , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Illah R. Nourbakhsh,et al.  Appearance-based place recognition for topological localization , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[13]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[14]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[15]  Peter Meer,et al.  Image Segmentation from Consensus Information , 1997, Comput. Vis. Image Underst..

[16]  M. Pietikäinen,et al.  TEXTURE ANALYSIS WITH LOCAL BINARY PATTERNS , 2004 .

[17]  Marcel Worring,et al.  Filter Image Browsing - Exploiting Interaction in Image Retrieval , 1999, VISUAL.

[18]  Martin Jägersand,et al.  Image-based localization with depth-enhanced image map , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  Liqiang Feng,et al.  Navigating Mobile Robots: Systems and Techniques , 1996 .

[20]  S Baronti,et al.  Variable Pyramid Structures for Image Segmentation , 1990, Comput. Vis. Graph. Image Process..

[21]  Clifford A. Shaffer,et al.  Optimal quadtree construction algorithms , 1987, Comput. Vis. Graph. Image Process..

[22]  Linda G. Shapiro,et al.  A Flexible Image Database System for Content-Based Retrieval , 1999, Comput. Vis. Image Underst..

[23]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[24]  Emanuele Frontoni,et al.  Appearance based robotics , 2006, IEEE Robotics & Automation Magazine.

[25]  James C. Bezdek,et al.  Efficient Implementation of the Fuzzy c-Means Clustering Algorithms , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Gregory D. Hager,et al.  Real-time vision-based robot localization , 1993, IEEE Trans. Robotics Autom..

[27]  Steven J. Simske,et al.  Performance analysis of pattern classifier combination by plurality voting , 2003, Pattern Recognit. Lett..

[28]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[29]  Thomas S. Huang,et al.  Supporting similarity queries in MARS , 1997, MULTIMEDIA '97.

[30]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[31]  Sophia Antipolis,et al.  EVALUATION METHODOLOGIES FOR IMAGE RETRIEVAL SYSTEMS , 2002 .

[32]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[33]  Peter F. M. Nacken.  Image segmentation by connectivity preserving relinking in hierarchical graph structures , 1995, Pattern Recognit..

[34]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[35]  Lawrence Sirovich,et al.  Management and Analysis of Large Scientific Datasets , 1992 .

[36]  Azriel Rosenfeld,et al.  A Pyramid Framework for Early Vision: Multiresolutional Computer Vision , 1993 .

[37]  Sugata Ghosal,et al.  iPURE: perceptual and user-friendly retrieval of images , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[38]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Sougata Mukherjea,et al.  AMORE: A World Wide Web image retrieval engine , 1999, World Wide Web.

[40]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Ben J. A. Kröse,et al.  A probabilistic model for appearance-based robot localization , 2001, Image Vis. Comput..

[42]  Ze-Nian Li,et al.  Illumination Invariance and Object Model in Content-Based Image and Video Retrieval , 1999, J. Vis. Commun. Image Represent..

[43]  Daniel G. Aliaga,et al.  Finding yourself [panoramic image sensors] , 2004, IEEE Robotics & Automation Magazine.

[44]  David G. Lowe,et al.  Local and global localization for mobile robots using visual landmarks , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[45]  Ioannis Patras,et al.  Combining color and shape information for illumination-viewpoint invariant object recognition , 2006, IEEE Transactions on Image Processing.

[46]  Walter G. Kropatsch,et al.  Guided Relinking of Graph Pyramids , 2000, SSPR/SPR.

[47]  Henrik I. Christensen,et al.  Model-driven vision for in-door navigation , 1994, Robotics Auton. Syst..

[48]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..