Feature alignment approach for hand posture recognition based on curvature scale space

One of the most important aspects of gesture recognition is recognizing hand postures. Much research has been devoted to extracting reliable features for hand posture recognition. In this paper, a new feature alignment approach for hand posture recognition based on curvature scale space (CSS) is presented. The basis point for alignment is based on the two-dimensional distribution of a coordinate-peak set of the CSS image instead of on the coordinate with the maximal peak. A convolution operation is performed with the sequence of a coordinate-peak set and a predefined function. The coordinate with the maximal convolution value is designated as a basis point for aligning the CSS features of the hand posture. Results show that the proposed approach performs well in recognizing hand postures. Furthermore, the proposed approach is more accurate than previous methods based on conventional features.

[1]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Akira Iwata,et al.  A rotation invariant approach on static-gesture recognition using boundary histograms and neural networks , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[3]  Mu-Chun Su,et al.  A static hand gesture recognition system using a composite neural network , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[4]  Josef Kittler,et al.  Enhancing CSS-based shape retrieval for objects with shallow concavities , 2000, Image Vis. Comput..

[5]  Pedro F. Felzenszwalb,et al.  Efficiently computing a good segmentation , 1998 .

[6]  A.W.G. Duller,et al.  Deformation invariant pattern classification for recognising hand gestures , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[7]  Edward Hunter,et al.  Vision based hand gesture interpretation using recursive estimation , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[8]  Jiangwen Deng,et al.  A PCA/MDA scheme for hand posture recognition , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[9]  Chung-Lin Huang,et al.  Sign language recognition using model-based tracking and a 3D Hopfield neural network , 1998, Machine Vision and Applications.

[10]  Farzin Mokhtarian,et al.  Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Agnès Just,et al.  Hand Posture Classification and Recognition using the Modified Census Transform , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[12]  Guozhong Dai,et al.  A New Invariant Descriptor For Shape Representation And Recognition , 2007, 2007 IEEE Symposium on Computational Intelligence in Image and Signal Processing.

[13]  Francis K. H. Quek,et al.  Inductive learning in hand pose recognition , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[14]  Ying Wu,et al.  View-independent recognition of hand postures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[16]  Jae-Ho Chung,et al.  Hand gesture recognition using orientation histogram , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).

[17]  Helge J. Ritter,et al.  Visual recognition of continuous hand postures , 2002, IEEE Trans. Neural Networks.

[18]  Attila Lics,et al.  Dynamic training of hand gesture recognition system , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[19]  P. F. Felzenzwalb.  Efficiently computing a good segmentation , 1998 .

[20]  Chung-Lin Huang,et al.  Sign language recognition using model-based tracking and a 3 D Hopfield neural network , 1998 .

[21]  Dong-Gyu Sim,et al.  A modified Zernike moment shape descriptor invariant to translation, rotation and scale for similarity-based image retrieval , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[22]  Yoshiaki Shirai,et al.  3-D hand posture recognition by training contour variation , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[23]  Thomas S. Huang,et al.  Static Hand Gesture Recognition based on Local Orientation Histogram Feature Distribution Model , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[24]  Daniel P. Huttenlocher,et al.  Image segmentation using local variation , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[25]  Jiangwen Deng,et al.  A novel two-layer PCA/MDA scheme for hand posture recognition , 2002, Object recognition supported by user interaction for service robots.

[26]  Chin-Chen Chang,et al.  Modified curvature scale space feature alignment approach for hand posture recognition , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[27]  Tamás Szirányi,et al.  Dynamic training of hand gesture recognition system , 2004, ICPR 2004.

[28]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Ulrich Neumann,et al.  Real-time Hand Pose Recognition Using Low-Resolution Depth Images , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[30]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Farzin Mokhtarian,et al.  A Theory of Multiscale, Curvature-Based Shape Representation for Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Xuelong Li,et al.  Supervised Tensor Learning , 2005, ICDM.

[33]  Niels da Vitoria Lobo,et al.  Segment-based hand pose estimation , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[34]  Vladimir Pavlovic,et al.  Hand Gesture Modeling, Analysis, and Synthesis , 1995 .

[35]  Alireza Khotanzad,et al.  Rotation invariant image recognition using features selected via a systematic method , 1990, Pattern Recognit..