Tracking articulated objects in real-time range image sequences

A simple algorithm for tracking the pose of articulated objects in real-time range image sequences is proposed. This method models each target segment as a planar patch bounded by the convex hull of two circles, and utilizes both edge-like and region-like information in matching the model to the target. It uses hard constraints for joint attachment and is designed to be robust to occlusions and missing data. Experimental results are presented in which a human arm is successfully tracked over 26 frames of real, video-rate range imagery.

[1]  Takeo Kanade,et al.  Visual Tracking of Self-Occluding Articulated Objects , 1994 .

[2]  Jake K. Aggarwal,et al.  Estimation of motion from a pair of range images: A review , 1991, CVGIP Image Underst..

[3]  C. Bregler,et al.  Video Motion Capture , 1997 .

[4]  Jake K. Aggarwal,et al.  Surface Correspondence and Motion Computation from a Pair of Range Images , 1996, Comput. Vis. Image Underst..

[5]  John G. Harris,et al.  Rigid body motion from range image sequences , 1991, CVGIP Image Underst..

[6]  Robert B. Fisher,et al.  Segmentation of range data into rigid subsets using surface patches , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Yiannis Aloimonos,et al.  Determining the 3-D motion of a rigid surface patch without correspondence, under perspective projection: I. planar surfaces. II. curved surfaces , 1986, AAAI 1986.

[8]  Michael G. Strintzis,et al.  3-D model-based segmentation of videoconference image sequences , 1998, IEEE Trans. Circuits Syst. Video Technol..

[9]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[10]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[11]  Nasser Kehtarnavaz,et al.  A framework for estimation of motion parameters from range images , 1989, Comput. Vis. Graph. Image Process..

[12]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[13]  Jake K. Aggarwal,et al.  Articulated and elastic non-rigid motion: a review , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[14]  Steven D. Blostein,et al.  MOTION ESTIMATION FROM 3-D POINT SETS WITH AND WITHOUT CORRESPONDENCES. , 1986 .

[15]  John Woodfill,et al.  Real-time stereo vision on the PARTS reconfigurable computer , 1997, Proceedings. The 5th Annual IEEE Symposium on Field-Programmable Custom Computing Machines Cat. No.97TB100186).

[16]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[18]  Jake K. Aggarwal,et al.  Segmentation of 3D range images using pyramidal data structures , 1990, [1990] Proceedings Third International Conference on Computer Vision.