A Light-weight Hand-waving Gesture Recognition Method Using Kinect V2 and Frequency Analysis

This paper describes a light-weight method for hand-waving gesture detection. Gesture recognition is actively researched as a user interface of robots. Conventional gesture recognition methods need to employ complicated pattern matching algorithms, such as DTW, HMM, and DNN, which require a powerful computing platform such as fast CPU or GPU that consumes much energy. We propose a gesture recognition/detection method specially designed for the recognition of hand-waving gesture. This method uses Kinect V2 as the sensor and detects the waving gesture using only a simple signal processing. The recognition experiment suggested that the proposed method gave sufficiently high accuracy, and the processing speed was much faster than real-time.

[1]  Weihua Sheng,et al.  Wearable Sensor-Based Hand Gesture and Daily Activity Recognition for Robot-Assisted Living , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Lu Yang,et al.  Survey on 3D Hand Gesture Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Shwetak N. Patel,et al.  AirLink: sharing files between multiple devices using in-air gestures , 2014, UbiComp.

[4]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Ankit Chaudhary,et al.  Robust gesture recognition using Kinect: A comparison between DTW and HMM , 2015 .

[6]  Nicolas D. Georganas,et al.  Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques , 2011, IEEE Transactions on Instrumentation and Measurement.

[7]  Paul Lukowicz,et al.  Waving Real Hand Gestures Recorded by Wearable Motion Sensors to a Virtual Car and Driver in a Mixed-Reality Parking Game , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[8]  Emil M. Petriu,et al.  Hand gesture detection and recognition using principal component analysis , 2011, 2011 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA) Proceedings.

[9]  Luc Van Gool,et al.  Real-time 3D hand gesture interaction with a robot for understanding directions from humans , 2011, 2011 RO-MAN.

[10]  Luca Maria Gambardella,et al.  Max-pooling convolutional neural networks for vision-based hand gesture recognition , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[11]  Yi Li,et al.  Hand gesture recognition using Kinect , 2012, 2012 IEEE International Conference on Computer Science and Automation Engineering.

[12]  Greg Mori,et al.  Action recognition by learning mid-level motion features , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Matteo Frigo,et al.  A fast Fourier transform compiler , 1999, SIGP.

[14]  Goutam Sanyal,et al.  Hand Gesture Recognition Systems: A Survey , 2013 .

[15]  Peter Stone,et al.  Solving Service Robot Tasks: UT Austin Villa@Home 2019 Team Report , 2019, ArXiv.

[16]  Daeho Lee,et al.  Vision-based remote control system by motion detection and open finger counting , 2009, IEEE Transactions on Consumer Electronics.

[17]  Lihui Wang,et al.  Gesture recognition for human-robot collaboration: A review , 2017, International Journal of Industrial Ergonomics.

[18]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[19]  Rainer Stiefelhagen,et al.  Visual recognition of pointing gestures for human-robot interaction , 2007, Image Vis. Comput..

[20]  Sebastian Thrun,et al.  A Gesture Based Interface for Human-Robot Interaction , 2000, Auton. Robots.

[21]  Chen-Chiung Hsieh,et al.  A real time hand gesture recognition system using motion history image , 2010, 2010 2nd International Conference on Signal Processing Systems.

[22]  Seong-Whan Lee.  Automatic gesture recognition for intelligent human-robot interaction , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[23]  Peter Xiaoping Liu,et al.  Visual gesture recognition for human-machine interface of robot teleoperation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[24]  Emilia I. Barakova,et al.  My Sparring Partner Is a Humanoid Robot , 2009, IWINAC.

[25]  L. Van Gool,et al.  Combining RGB and ToF cameras for real-time 3D hand gesture interaction , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[26]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[27]  Michael J. Swain,et al.  Happy patrons make better tippers: creating a robot waiter using Perseus and the Animate Agent architecture , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[28]  Paul Lukowicz,et al.  Continuous recognition of arm activities with body-worn inertial sensors , 2004, Eighth International Symposium on Wearable Computers.

[29]  M. Desai,et al.  The discrete frequency Fourier transform , 1986 .

[30]  Ao Tang,et al.  A Real-Time Hand Posture Recognition System Using Deep Neural Networks , 2015, ACM Trans. Intell. Syst. Technol..