Hand gesture based control strategy for mobile robots

In this paper, a hand gesture based control design is proposed for mobile robots. Mobile robots can move according to the control signals encoded by hand gestures. The gesture region is segmented from complicated background and the gestures are recognized by using some techniques such as image processing, image filtering processing, morphological image processing, image contour processing, etc. Then a template matching algorithm is proposed with the help of the invariant moment matching method to recognize the hand gestures. The recognition results are decoded as feedback information to control the mobile robots. Finally, some simulation results are provided to validate the proposed control algorithm.

[1]  K. Martin,et al.  Vector filtering for color imaging , 2005, IEEE Signal Processing Magazine.

[2]  Vladimir Pavlovic,et al.  A visual computing environment for very large scale biomolecular modeling , 1997, Proceedings IEEE International Conference on Application-Specific Systems, Architectures and Processors.

[3]  Frederick M. Waltz,et al.  Morphological Image Processing , 2012 .

[4]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[5]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.

[6]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[7]  Xu Yulin,et al.  Real-Time Hand Gesture Recognition for Robot Hand Interface , 2014 .

[8]  Francis K. H. Quek,et al.  Inductive learning in hand pose recognition , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[9]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[10]  Quan Pan,et al.  Image recognition based on invariant moment in the projection space , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[11]  Kandarpa Kumar Sarma,et al.  A Review on Vision-Based Hand Gesture Recognition and Applications , 2015 .

[12]  Ana-Maria Cretu,et al.  Natural human-computer interaction using static and dynamic hand gestures , 2015, 2015 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE).

[13]  Agnès Just,et al.  Two-Handed Gestures for Human-Computer Interaction , 2006 .

[14]  Chen-Chiung Hsieh,et al.  A real time hand gesture recognition system using motion history image , 2010, 2010 2nd International Conference on Signal Processing Systems.

[15]  Chih-Hung Wu,et al.  Depth-based hand gesture recognition , 2015, Multimedia Tools and Applications.