Towards 3D hand tracking using a deformable model

In this paper we first describe how we have constructed a 3D deformable Point Distribution Model of the human hand, capturing training data semi-automatically from volume images via a physically-based model. We then show how we have attempted to use this model in tracking an unmarked hand moving with 6 degrees of freedom (plus deformation) in real time using a single video camera. In the course of this we show how to improve on a weighted least-squares pose parameter approximation at little computational cost. We note the successes and shortcomings of our system and discuss how it might be improved.

[1]  Timothy F. Cootes,et al.  Active Shape Models and the Shape Approximation Problem , 1995, BMVC.

[2]  Geoffrey D. Sullivan,et al.  Pose and Structure Recovery using Active Models , 1995, BMVC.

[3]  David C. Hogg,et al.  3D Deformable Hand Models , 1996, Gesture Workshop.

[4]  Timothy F. Cootes,et al.  A Generic System For Classifying Variable Objects Using Flexible Template Matching , 1993, BMVC.

[5]  Hervé Delingette,et al.  Simplex meshes: a general representation for 3D shape reconstruction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  David C. Hogg,et al.  Extending the Point Distribution Model Using Polar Coordinates , 1995, CAIP.

[7]  David C. Hogg,et al.  An efficient method for contour tracking using active shape models , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[8]  Takeo Kanade,et al.  Model-based tracking of self-occluding articulated objects , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[10]  David C. Hogg,et al.  Extending the Point Distribution Model Using Polar Coordinates , 1995, CAIP.

[11]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Michael Isard,et al.  3D position, attitude and shape input using video tracking of hands and lips , 1994, SIGGRAPH.

[13]  Christopher J. Taylor,et al.  Model-Based Interpretation of 3D Medical Images , 1993, BMVC.

[14]  David C. Hogg,et al.  An Eecient Method for Contour Tracking Using Active Shape Models , 1994 .

[15]  Takeo Kanade,et al.  Visual Tracking of Self-Occluding Articulated Objects , 1994 .

[16]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[17]  Xinquan Shen,et al.  Generic 3-D Shape Model: Acquisitions and Applications , 1995, CAIP.