Hierarchical recognition of articulated objects from single perspective views

This paper presents an approach to the recognition of articulated 3D objects in monocular video images. A hierarchical object representation models objects as a composition of rigid components which are explicitly connected by specific kinematic constraints, e.g., rotational and/or translational joints. The recognition task follows this tree-like structure by first estimating the 3D pose of the static component (root) and afterwards determining the relative 3D pose of the remaining components recursively. This method limits the search space for the actual correspondences between image and model features and copes with the problem of self-occlusion. Experiments in the context of autonomous, mobile robots show the practicability of this approach.

[1]  Bernd Korn,et al.  Erkennung und Bestimmung der aktuellen Konstellation von Objekten mit Scharniergelenken , 1996, DAGM-Symposium.

[2]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[3]  Kevin W. Bowyer,et al.  Computing the visual potential of an articulated assembly of parts , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Michel Dhome,et al.  Determination of the Pose of an Articulated Object From a Single Perspective View , 1993, BMVC.

[5]  S. Lanser,et al.  On the selection of candidates for point and line correspondences , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[6]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[7]  Christoph Zierl,et al.  Robust Video-Based Object Recognition Using CAD Models , 1995 .

[8]  Herbert Freeman,et al.  Machine Vision for Three-Dimensional Scenes , 1990 .

[9]  Martial Hebert,et al.  Object Representation in Computer Vision II , 1996, Lecture Notes in Computer Science.

[10]  Christoph Zierl,et al.  On the use of topological constraints within object recognition tasks , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Alexa Hauck,et al.  A hierarchical world model with sensor- and task-specific features , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[12]  Alexa Hauck,et al.  VIDEO-BASED DETERMINATION OF THE JOINT STATES OF ARTICULATED OBJECTS , 1996 .

[13]  大野 義夫,et al.  Computer Graphics : Principles and Practice, 2nd edition, J.D. Foley, A.van Dam, S.K. Feiner, J.F. Hughes, Addison-Wesley, 1990 , 1991 .

[14]  Anil K. Jain,et al.  CAD-Based Computer Vision: From CAD Models to Relational Graphs , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Anil K. Jain,et al.  CAD-Based Computer Vision: From CAD Models to Relational Graphs , 1989, IEEE Trans. Pattern Anal. Mach. Intell..