Applications of hand gestures recognition in industrial robots: a review

Hand gesture recognition (HGR) is a natural way of Human Machine Interaction and has been applied on different areas. In this paper, we discuss works done in the area of applications of HGR in industrial robots where focus is on the processing steps and techniques in gesture-based Human Robot Interaction (HRI), which can provide useful information for other researchers. We review several related works in the area of HGR based on different approaches including sensor based approach and vision approach. After comparing the two approaches, we found that 3D vision-based HGR method is a challenging but promising researching area. Then, concerning works of implementation of HGR in industrial scenario are discussed in detail. Pattern recognition algorithms that effectively used in HGR like k-means, DTW etc. are briefly introduced as well.

[1]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[2]  Guillaume Doisy,et al.  Position-invariant, real-time gesture recognition based on dynamic time warping , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  Fang Yuan,et al.  Static hand gesture recognition based on HOG characters and support vector machines , 2013, 2013 2nd International Symposium on Instrumentation and Measurement, Sensor Network and Automation (IMSNA).

[4]  Othman O. Khalifa,et al.  Electromygraphy (EMG) signal based hand gesture recognition using artificial neural network (ANN) , 2011, 2011 4th International Conference on Mechatronics (ICOM).

[5]  Xi Chen,et al.  A novel method for simultaneous gesture segmentation and recognition based on HMM , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[6]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[7]  Jun-Jie Wang,et al.  Improvement of Dynamic Hand Gesture Recognition Based on HMM Algorithm , 2016, 2016 International Conference on Information System and Artificial Intelligence (ISAI).

[8]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[9]  S. Abdul-Kareem,et al.  RETRACTED ARTICLE: Static hand gesture recognition using neural networks , 2014, Artificial Intelligence Review.

[10]  Weihua Sheng,et al.  Human gesture recognition through a Kinect sensor , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[11]  Amardeep Singh,et al.  Static vision based Hand Gesture recognition using principal component analysis , 2015, 2015 IEEE 3rd International Conference on MOOCs, Innovation and Technology in Education (MITE).

[12]  Ravindra Sor,et al.  A Review on Hand Gesture Recognition System , 2015, International Conference on Computing Communication Control and automation.

[13]  Antonio Gentile,et al.  Real-Time Hand Pose Recognition Based on a Neural Network Using Microsoft Kinect , 2013, 2013 Eighth International Conference on Broadband and Wireless Computing, Communication and Applications.

[14]  Karl F. MacDorman,et al.  Review of constraints on vision-based gesture recognition for human-computer interaction , 2018, IET Comput. Vis..

[15]  Lu Yang,et al.  Survey on 3D Hand Gesture Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Jen-Jee Chen,et al.  Integration of open source platform duckietown and gesture recognition as an interactive interface for the museum robotic guide , 2018, 2018 27th Wireless and Optical Communication Conference (WOCC).

[18]  Rui Zhang,et al.  Dynamic Gesture Recognition Method Based on Improved DTW Algorithm , 2017, 2017 International Conference on Industrial Informatics - Computing Technology, Intelligent Technology, Industrial Information Integration (ICIICII).

[19]  Tin Hninn Hninn Maung,et al.  Real-Time Hand Tracking and Gesture Recognition System Using Neural Networks , 2009 .

[20]  Wei Lu,et al.  Dynamic Hand Gesture Recognition With Leap Motion Controller , 2016, IEEE Signal Processing Letters.

[21]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[22]  Srinivas Ganapathyraju,et al.  Hand gesture recognition using convexity hull defects to control an industrial robot , 2013, 2013 3rd International Conference on Instrumentation Control and Automation (ICA).

[23]  Hyotaek Lim,et al.  Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware , 2015, Multimedia Tools and Applications.

[24]  Sungyoung Lee,et al.  Two-stage Hidden Markov Model in Gesture Recognition for Human Robot Interaction , 2012 .

[25]  Neil M. Robertson,et al.  A proposed gesture set for the control of industrial collaborative robots , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[26]  Yan Jiang,et al.  Sparse decomposition for data glove gesture recognition , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[27]  Hyo-Rim Choi,et al.  A DTW gesture recognition system based on gesture orientation histogram , 2014, The 18th IEEE International Symposium on Consumer Electronics (ISCE 2014).

[28]  G. R. Nudd,et al.  The Viterbi Algorithm , 1993 .

[29]  Hyunchul Shin,et al.  Hand gesture recognition using deep learning , 2017, 2017 International SoC Design Conference (ISOCC).

[30]  Razvan C. Bunescu,et al.  Recognition of Dynamic Hand Gestures from 3D Motion Data Using LSTM and CNN Architectures , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[31]  Bin Li,et al.  A real-time gesture prediction system using neural networks and multimodal fusion based on data glove , 2018, 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI).