Gesture Recognition Based on Elastic Deformation Energies

We present a method for recognizing gesture motions based on elastic deformable shapes and curvature templates. Gestures are modeled using a spline curve representation that is enhanced with elastic properties: the entire spline or any of its parts may stretch or bend. The energy required to transform a gesture into a given template gives an estimation of the similarity between the two. We demonstrate the results of our gesture classifier with a video-based acquisition approach.

[1]  Thomas S. Huang,et al.  Constructing finite state machines for fast gesture recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  S. Timoshenko,et al.  Theory of Elasticity (3rd ed.) , 1970 .

[3]  Rachid Deriche,et al.  2-D curve matching using high curvature points: application to stereo vision , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[4]  Hang Joon Kim,et al.  Real Time Hand Tracking Based on Active Contour Model , 2005, ICCSA.

[5]  Joaquim A. Jorge,et al.  Experimental Evaluation of a Trainable Scribble Recognizer for Calligraphic Interfaces , 2001, GREC.

[6]  J. Hershberger,et al.  Speeding Up the Douglas-Peucker Line-Simplification Algorithm , 1992 .

[7]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[8]  Brigitte Dorner,et al.  CHASING THE COLOUR GLOVE: VISUAL HAND TRACKING , 1994 .

[9]  Philip N. Klein,et al.  On Aligning Curves , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  David Taniar,et al.  Computational Science and Its Applications - ICCSA 2005, International Conference, Singapore, May 9-12, 2005, Proceedings, Part I , 2005, ICCSA.

[11]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  G. Farin,et al.  Curve Shapes : Comparison and Alignment , 2004 .

[13]  J. Y. Lee,et al.  An Elliptical Boundary Model for Skin Color Detection , 2002 .

[14]  Hemant D. Tagare,et al.  Shape-based nonrigid correspondence with application to heart motion analysis , 1999, IEEE Transactions on Medical Imaging.

[15]  Joaquim A. Jorge,et al.  CALI: An Online Scribble Recognizer for Calligraphic Interfaces , 2002 .

[16]  H. Piaggio.  Differential Geometry of Curves and Surfaces , 1952, Nature.

[17]  Nicholas Ayache,et al.  Tracking Points on Deformable Objects Using Curvature Information , 1992, ECCV.

[18]  R. Watson.  A Survey of Gesture RecognitionTechniques. , 1993 .

[19]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Aaron F. Bobick,et al.  Realtime online adaptive gesture recognition , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[21]  Mathias Kölsch,et al.  Analysis of rotational robustness of hand detection with a Viola-Jones detector , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[22]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Mathias Kölsch,et al.  Hand Tracking with Flocks of Features , 2005, CVPR.

[24]  Philip N. Klein,et al.  Alignment-Based Recognition of Shape Outlines , 2001, IWVF.

[25]  E. Catmull,et al.  A CLASS OF LOCAL INTERPOLATING SPLINES , 1974 .

[26]  Jr. Joseph J. LaViola,et al.  A Survey of Hand Posture and Gesture Recognition Techniques and Technology , 1999 .

[27]  Michael Garland,et al.  Curvature maps for local shape comparison , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[28]  Luiz A. Costa,et al.  Determining the similarity of deformable shapes , 1995, Vision Research.

[29]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[30]  Robert Azencott,et al.  A distance for elastic matching in object recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[31]  Mathias Kölsch,et al.  Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[32]  Sadegh Abbasi,et al.  Shape similarity retrieval under affine transforms , 2002, Pattern Recognit..

[33]  Daniela Hall,et al.  Statistical Gesture Recognition Through Modelling of Parameter Trajectories , 1999, Gesture Workshop.

[34]  Thomas B. Moeslund,et al.  A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI , 2003, Gesture Workshop.

[35]  G. Sandini,et al.  Computer Vision — ECCV'92 , 1992, Lecture Notes in Computer Science.

[36]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  R. Watson.  A Survey of Gesture Recognition Techniques , 1993 .

[38]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[39]  mc schraefel,et al.  A Taxonomy of Gestures in Human Computer Interactions , 2005 .