Real-time Learning and Detection of 3D Texture-less Objects: A Scalable Approach

We present a method for the learning and detection of multiple rigid texture-less 3D objects intended to operate at frame rate speeds for video input. The method is geared for fast and scalable learning and detection by combining tractable extraction of edgelet constellations with library lookup based on rotationand scale-invariant descriptors. The approach learns object views in real-time, and is generative enabling more objects to be learnt without the need for re-training. During testing, a random sample of edgelet constellations is tested for the presence of known objects. We perform testing of single and multi-object detection on a 30 objects dataset showing detections of any of them within milliseconds from the object’s visibility. The results show the scalability of the approach and its framerate performance.

[1]  Markus Ulrich,et al.  Recognition and Tracking of 3D Objects , 2008, DAGM-Symposium.

[2]  W. Eric L. Grimson,et al.  On the sensitivity of geometric hashing , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[3]  Andrew Zisserman,et al.  A Boundary-Fragment-Model for Object Detection , 2006, ECCV.

[4]  Rama Chellappa,et al.  Fast directional chamfer matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Susanto Rahardja,et al.  Object recognition by discriminative combinations of line segments and ellipses , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  John Illingworth,et al.  ForeSight: fast object recognition using geometric hashing with edge-triple features , 1997, Proceedings of International Conference on Image Processing.

[7]  Martial Hebert,et al.  Object Recognition by a Cascade of Edge Probes , 2002, BMVC.

[8]  Björn Ommer,et al.  Voting by Grouping Dependent Parts , 2010, ECCV.

[9]  Cordelia Schmid,et al.  Bandit Algorithms for Tree Search , 2007, UAI.

[10]  Stefan Carlsson,et al.  Automatic learning and extraction of multi-local features , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Jitendra Malik,et al.  Object detection using a max-margin Hough transform , 2009, CVPR.

[12]  Andrew Blake,et al.  Contour-based learning for object detection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  Martial Hebert,et al.  Beyond Local Appearance: Category Recognition from Pairwise Interactions of Simple Features , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[15]  Luc Van Gool,et al.  Object Detection by Contour Segment Networks , 2006, ECCV.

[16]  Dima Damen,et al.  Detecting and Localising Multiple 3D Objects: A Fast and Scalable Approach , 2011 .

[17]  Silvio Savarese,et al.  3D generic object categorization, localization and pose estimation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Vincent Lepetit,et al.  Dominant orientation templates for real-time detection of texture-less objects , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Juergen Gall,et al.  Class-specific Hough forests for object detection , 2009, CVPR.

[20]  David A. Forsyth,et al.  Canonical Frames for Planar Object Recognition , 1992, ECCV.

[21]  Yehezkel Lamdan,et al.  Geometric Hashing: A General And Efficient Model-based Recognition Scheme , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[22]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[23]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Vincent Lepetit,et al.  Fast Keypoint Recognition Using Random Ferns , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Sanja Fidler,et al.  A Coarse-to-Fine Taxonomy of Constellations for Fast Multi-class Object Detection , 2010, ECCV.

[26]  David G. Lowe,et al.  Indexing without Invariants in 3D Object Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..