An Investigation of Applications of Hand Gestures Recognition in Industrial Robots

Hand gesture recognition (HGR) is a natural way of Human Machine Interaction and has been applied on different areas. In this paper, we discussed works done in the area of applications of HGR in industrial robots where focus is on the processing steps and techniques in gesturebased Human Robot Interaction (HRI), which can provide useful information for other researchers. We reviewed several related works in the area of HGR based on different methods including sensor based approaches and vision based approaches. After comparing the two types of approaches, we found that 3D vision-based HGR method is a challenging but promising researching area. Then concerning works of implementation of HGR in industrial scenario are discussed in detail. Pattern recognition algorithms that effectively used in HGR like k-means, DTW etc. are briefly introduced as well. Finally, after reviewing some works done in the area of designing gesture set, we proposed several principles in designing industrial hand gesture commands. 

[1]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[2]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[4]  Hyo-Rim Choi,et al.  A DTW gesture recognition system based on gesture orientation histogram , 2014, The 18th IEEE International Symposium on Consumer Electronics (ISCE 2014).

[5]  Amardeep Singh,et al.  Static vision based Hand Gesture recognition using principal component analysis , 2015, 2015 IEEE 3rd International Conference on MOOCs, Innovation and Technology in Education (MITE).

[6]  Jen-Jee Chen,et al.  Integration of open source platform duckietown and gesture recognition as an interactive interface for the museum robotic guide , 2018, 2018 27th Wireless and Optical Communication Conference (WOCC).

[7]  Rui Zhang,et al.  Dynamic Gesture Recognition Method Based on Improved DTW Algorithm , 2017, 2017 International Conference on Industrial Informatics - Computing Technology, Intelligent Technology, Industrial Information Integration (ICIICII).

[8]  Jun-Jie Wang,et al.  Improvement of Dynamic Hand Gesture Recognition Based on HMM Algorithm , 2016, 2016 International Conference on Information System and Artificial Intelligence (ISAI).

[9]  Simon Fong.  Using Hierarchical Time Series Clustering Algorithm and Wavelet Classifier for Biometric Voice Classification , 2012, Journal of biomedicine & biotechnology.

[10]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[11]  Tin Hninn Hninn Maung,et al.  Real-Time Hand Tracking and Gesture Recognition System Using Neural Networks , 2009 .

[12]  Wei Lu,et al.  Dynamic Hand Gesture Recognition With Leap Motion Controller , 2016, IEEE Signal Processing Letters.

[13]  Karl F. MacDorman,et al.  Review of constraints on vision-based gesture recognition for human-computer interaction , 2018, IET Comput. Vis..

[14]  Guillaume Doisy,et al.  Position-invariant, real-time gesture recognition based on dynamic time warping , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Yan Jiang,et al.  Sparse decomposition for data glove gesture recognition , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[16]  Othman O. Khalifa,et al.  Electromygraphy (EMG) signal based hand gesture recognition using artificial neural network (ANN) , 2011, 2011 4th International Conference on Mechatronics (ICOM).

[17]  Xi Chen,et al.  A novel method for simultaneous gesture segmentation and recognition based on HMM , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[18]  Keith C. C. Chan,et al.  A Model-Based Multivariate Time Series Clustering Algorithm , 2014, PAKDD Workshops.

[19]  Sungyoung Lee,et al.  Two-stage Hidden Markov Model in Gesture Recognition for Human Robot Interaction , 2012 .

[20]  Neil M. Robertson,et al.  A proposed gesture set for the control of industrial collaborative robots , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[21]  Fang Yuan,et al.  Static hand gesture recognition based on HOG characters and support vector machines , 2013, 2013 2nd International Symposium on Instrumentation and Measurement, Sensor Network and Automation (IMSNA).

[22]  G. R. Nudd,et al.  The Viterbi Algorithm , 1993 .

[24]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[25]  Weihua Sheng,et al.  Human gesture recognition through a Kinect sensor , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[26]  Srinivas Ganapathyraju,et al.  Hand gesture recognition using convexity hull defects to control an industrial robot , 2013, 2013 3rd International Conference on Instrumentation Control and Automation (ICA).

[27]  Bin Li,et al.  A real-time gesture prediction system using neural networks and multimodal fusion based on data glove , 2018, 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI).