Gesture Recognition using MHI Shape Information

In this paper, we propose a gesture recognition system to recognize motions using the shape information of MHI (Motion History Image). The system acquires MHI to provide information on motions from images with input and extracts the gradient images from such MHI for each X and Y coordinate. It extracts the shape information by applying the shape context to each gradient image and uses the extracted pattern information values as the feature values. It recognizes motions by learning and classifying the obtained feature values with a SVM (Support Vector Machine) classifier. The suggested system is able to recognize the motions for multiple people as well as to recognize the direction of movements by using the shape information of MHI. In addition, it shows a high ratio of recognition with a simple method to extract features.

[1]  Michael J. Black,et al.  Parameterized Modeling and Recognition of Activities , 1999, Comput. Vis. Image Underst..

[2]  H. Kikuchi,et al.  Motion capture system of magnetic markers using three-axial magnetic field sensor , 2000 .

[3]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[4]  Horst-Michael Groß,et al.  Camera-based gesture recognition for robot control , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[5]  A. Corradini,et al.  Dynamic time warping for off-line recognition of a small gesture vocabulary , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[6]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Lihi Zelnik-Manor,et al.  Event-based analysis of video , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  David J. Kriegman,et al.  A Real-Time Approach to the Spotting, Representation, and Recognition of Hand Gestures for Human-Computer Interaction , 2002, Comput. Vis. Image Underst..

[9]  Francis Schmitt,et al.  Silhouette and stereo fusion for 3D object modeling , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[10]  Maja J. Mataric,et al.  Motion capture from inertial sensing for untethered humanoid teleoperation , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[11]  S. Yabukami,et al.  Development of real-time and highly accurate wireless motion capture system utilizing soft magnetic core , 2005, IEEE Transactions on Magnetics.

[12]  Katsu Yamane,et al.  High Marker Density Motion Capture by Retroreflective Mesh Suit , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[13]  Francisco José Madrid-Cuevas,et al.  Depth silhouettes for gesture recognition , 2008, Pattern Recognit. Lett..

[14]  Young Hoon Joo,et al.  Movement Detection Algorithm Using Virtual Skeleton Model , 2008 .

[15]  Francisco José Madrid-Cuevas,et al.  Shape from silhouette using Dempster-Shafer theory , 2010, Pattern Recognit..

[16]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[17]  Neha Mehan,et al.  Recognition of Human Actions Using Motion History Information Extracted from the Compressed , 2013 .