Novel Algorithm for Hand Gesture Recognition Utilizing a Wrist-Worn Inertial Sensor

In this paper, we propose a dynamic time warping (DTW)-based template matching method with a novel template generation algorithm for hand gesture recognition utilizing a wrist-worn inertial sensor. Hand orientation measurements are utilized to reconstruct gesture trajectories. The DTW technique with the Riemannian distance is employed to perform similarity measurements between gesture orientation trajectories. The proposed gesture recognition algorithm comprises three stages: a data preprocessing stage, a training stage, and a recognition stage. First, a moving intrinsic average filter is introduced to suppress the effects of measurement noise and unconscious hand shaking. Next, a double-threshold segmentation scheme is applied to extract individual gesture segments. In the training stage, to cope with temporal and spatial variations in gestures, an adaptive DTW barycenter averaging algorithm combined with an intrinsic averaging method is developed to generate gesture templates. A suitable rejection threshold is determined according to intra-class DTW distances. In the recognition stage, the rejection percentage between the input gesture and each gesture template is calculated. Finally, the nearest neighbor decision rule is applied to determine the recognition result. Experiments performed on a database of 3600 gesture samples illustrate that the proposed DTW-based gesture template generation and classification algorithm outperforms existing methods.

[1]  Arti Khaparde,et al.  Gesture recognition using DTW & piecewise DTW , 2014, 2014 International Conference on Electronics and Communication Systems (ICECS).

[2]  Tae-Seong Kim,et al.  3-D hand motion tracking and gesture recognition using a data glove , 2009, 2009 IEEE International Symposium on Industrial Electronics.

[3]  Luca Benini,et al.  A Versatile Embedded Platform for EMG Acquisition and Gesture Recognition , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[4]  Vit Niennattrakul,et al.  Shape-based template matching for time series data , 2012, Knowl. Based Syst..

[5]  Sung-Bae Cho,et al.  Online Gesture Recognition for User Interface on Accelerometer Built-in Mobile Phones , 2010, ICONIP.

[6]  Xia Sun,et al.  Similarity Matching-Based Extensible Hand Gesture Recognition , 2015, IEEE Sensors Journal.

[7]  Norbert Link,et al.  Gesture recognition with inertial sensors and optimized DTW prototypes , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[8]  M Benisha,et al.  An Inertial Pen with Dynamic Time Warping Recognizer for Handwriting and Gesture Recognition , 2016 .

[9]  David Schultz,et al.  Nonsmooth analysis and subgradient methods for averaging in dynamic time warping spaces , 2017, Pattern Recognit..

[10]  Renqiang Xie,et al.  Accelerometer-Based Hand Gesture Recognition by Neural Network and Similarity Matching , 2016, IEEE Sensors Journal.

[11]  Hongdong Li,et al.  Rotation Averaging , 2013, International Journal of Computer Vision.

[12]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Tao Lu A motion control method of intelligent wheelchair based on hand gesture recognition , 2013, 2013 IEEE 8th Conference on Industrial Electronics and Applications (ICIEA).

[14]  Karel Zikan,et al.  A note on averaging rotations , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[15]  Kongqiao Wang,et al.  Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors , 2009, IUI.

[16]  Salvatore Sessa,et al.  Towards Miniaturization of a MEMS-Based Wearable Motion Capture System , 2011, IEEE Transactions on Industrial Electronics.

[17]  Purnendu Sinha,et al.  Hand Movements and Gestures Characterization Using Quaternion Dynamic Time Warping Technique , 2016, IEEE Sensors Journal.

[18]  Jeen-Shing Wang,et al.  An Accelerometer-Based Digital Pen With a Trajectory Recognition Algorithm for Handwritten Digit and Gesture Recognition , 2012, IEEE Transactions on Industrial Electronics.

[19]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[20]  Mohan Kumar,et al.  Using dynamic time warping for online temporal fusion in multisensor systems , 2008, Inf. Fusion.

[21]  Dipak Kumar Ghosh,et al.  Hand gesture recognition using DWT and F-ratio based feature descriptor , 2018, IET Image Process..

[22]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[23]  Ling Shao,et al.  Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Asha,et al.  A Hand Gesture Recognition Framework and Wearable Gesture Based Interaction Prototype for Mobile Devices , 2015 .

[26]  G. C. Nandi,et al.  Implementation and evaluation of DWT and MFCC based ISL gesture recognition , 2014, 2014 9th International Conference on Industrial and Information Systems (ICIIS).

[27]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[28]  Fumio Harashima,et al.  Natural Interface Using Pointing Behavior for Human–Robot Gestural Interaction , 2007, IEEE Transactions on Industrial Electronics.

[29]  Alena KOPANIČÁKOVÁ,et al.  Gesture Recognition using DTW and its Application Potential in Human-Centered Robotics , 2013 .

[30]  C. Ratanamahatana,et al.  Shape averaging under Time Warping , 2009, 2009 6th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[31]  Jonathan H. Manton,et al.  A globally convergent numerical algorithm for computing the centre of mass on compact Lie groups , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[32]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[33]  Alberto Calatroni,et al.  Improving online gesture recognition with template matching methods in accelerometer data , 2012, 2012 12th International Conference on Intelligent Systems Design and Applications (ISDA).

[34]  Xiaoping Yun,et al.  Design, Implementation, and Experimental Results of a Quaternion-Based Kalman Filter for Human Body Motion Tracking , 2006, IEEE Trans. Robotics.

[35]  Maher Moakher,et al.  To appear in: SIAM J. MATRIX ANAL. APPL. MEANS AND AVERAGING IN THE GROUP OF ROTATIONS∗ , 2002 .

[36]  Shahrokh Valaee,et al.  A Novel Accelerometer-based Gesture Recognition System by , 2010 .