Object recognition and pose estimation using color cooccurrence histograms and geometric modeling

Robust techniques for object recognition and pose estimation are essential for robotic manipulation and object grasping. In this paper, a novel approach for object recognition and pose estimation based on color cooccurrence histograms and geometric modelling is presented. The particular problems addressed are: (i) robust recognition of objects in natural scenes, (ii) estimation of partial pose using an appearance based approach, and (iii) complete 6DOF model based pose estimation and tracking using geometric models. Our recognition scheme is based on the color cooccurrence histograms embedded in a classical learning framework that facilitates a 'winner-takes-all' strategy across different views and scales. The hypotheses generated in the recognition stage provide the basis for estimating the orientation of the object around the vertical axis. This prior, incomplete pose information is subsequently made precise by a technique that facilitates a geometric model of the object to estimate and continuously track the complete 6DOF pose of the object. Major contributions of the proposed system are the ability to automatically initiate an object tracking process, its robustness and invariance towards scaling and translations as well as the computational efficiency since both recognition and pose estimation rely on the same representation of the object. The performance of the system is evaluated in a domestic environment with changing lighting and background conditions on a set of everyday objects.

[1]  Helder Araujo,et al.  A Fully Projective Formulation for Lowe's Tracking Algorithm , 1996 .

[2]  Lindsay Kleeman,et al.  Fusion of multimodal visual cues for model-based object tracking , 2003 .

[3]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[4]  Hans-Hellmut Nagel,et al.  Automatic dismantling integrating optical flow into a machine vision-controlled robot system , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[5]  Wolfgang Ponweiser,et al.  Edge-Projected Integration of Image and Model Cues for Robust Model-Based Object Tracking , 2001, Int. J. Robotics Res..

[6]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[7]  Danica Kragic,et al.  Model based techniques for robotic servoing and grasping , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Gerd Hirzinger,et al.  Real-time pose estimation of 3D objects from camera images using neural networks , 1997, Proceedings of International Conference on Robotics and Automation.

[9]  Patric Jensfelt,et al.  Experiments on augmenting CONDENSATION for mobile robot localization , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Lars Petersson,et al.  DCA: a distributed control architecture for robotics , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[11]  Éric Marchand,et al.  A real-time tracker for markerless augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[12]  Danny Roobaert.  Pedagogical support vector learning : a pure learning approach to object recognition , 2001 .

[13]  Gregory D. Hager,et al.  Robust Vision for Vision-Based Control of Motion , 1999 .

[14]  Roy Eagleson,et al.  Human visual servoing for reaching and grasping: the role of 3D geometric features , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[15]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[16]  Lars Petersson,et al.  Systems integration for real-world manipulation tasks , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[17]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[18]  Vincent Lepetit,et al.  Stable real-time 3D tracking using online and offline information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Stepán Obdrzálek,et al.  Object Recognition using Local Affine Frames on Distinguished Regions , 2002, BMVC.

[20]  John Krumm,et al.  Object recognition with color cooccurrence histograms , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[21]  Danica Kragic.  Visual Servoing for Manipulation : Robustness and Integration Issues , 2001 .

[22]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[23]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[24]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[25]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Lars Bretzner,et al.  Multi-scale feature tracking and motion estimation , 1999 .

[27]  Gerd Hirzinger,et al.  Real-time visual tracking of 3D objects with dynamic handling of occlusion , 1997, Proceedings of International Conference on Robotics and Automation.

[28]  Tony Lindeberg,et al.  Object recognition using composed receptive field histograms of higher dimensionality , 2004, ICPR 2004.

[29]  Larry S. Davis,et al.  Model-Based Object Pose in 25 Lines of Code , 1992, ECCV.

[30]  Massimiliano Pontil,et al.  Support Vector Machines for 3D Object Recognition , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[32]  David G. Stork,et al.  Pattern Classification , 1973 .

[33]  Alex Pentland,et al.  Probabilistic object recognition and localization , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[34]  Hiroshi Murase,et al.  Subspace methods for robot vision , 1996, IEEE Trans. Robotics Autom..

[35]  Roberto Cipolla,et al.  Real-Time Tracking of Multiple Articulated Structures in Multiple Views , 2000, ECCV.

[36]  Markus Vincze,et al.  An Integrated Framework for Robust Real-Time 3D Object Tracking , 1999, ICVS.

[37]  Volker Graefe,et al.  Dynamic monocular machine vision , 1988, Machine Vision and Applications.

[38]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[39]  Gregory D. Hager,et al.  TwoDimensional ModelBased Tracking of Complex Shapes for Visual Servoing Tasks , 2000 .