A system for accelerometer-based gesture classification using artificial neural networks

A great many people suffer from neurological movement disorders that render typical hardware interface devices ineffective. A need exists for a universal interface device that can be trained to accept a wide range of inputs across varying types and severities of movement disorders. In this regard, this paper details the design, testing and optimization of an accelerometer-based gesture identification system. A Bluetooth-enabled IMU mounted on the wrist provides hand motion trajectory information to a local terminal. Several techniques are applied to decrease the intra-class variance and reduce classifier complexity including filtering, segmentation and temporal scaling. Datasets consisted of 520 training samples, 260 validation samples and a further 520 testing samples. A multi-layer feed forward artificial neural network (ML-FFNN) was used to classify the input space into 26 different classes. Initial system accuracy, using arbitrary hyperparameters was 77.69% with final optimized accuracy at 99.42%.

[1]  Jing Yang,et al.  Magic wand: a hand-drawn gesture input device in 3-D space with inertial sensors , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[2]  Jing Yang,et al.  Inertial sensor based recognition of 3-D character gestures with an ensemble classifiers , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[3]  Uchechukwu C. Wejinya,et al.  Real-time written-character recognition using MEMS motion sensors: Calibration and experimental results , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[4]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Sang Wook Lee,et al.  Subject-Specific Myoelectric Pattern Classification of Functional Hand Movements for Stroke Survivors , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Marion F Walker,et al.  Evidence-Based Community Stroke Rehabilitation , 2013, Stroke.

[7]  Kongqiao Wang,et al.  Hand Gesture Recognition Research Based on Surface EMG Sensors and 2D-accelerometers , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[8]  Leontios J. Hadjileontiadis,et al.  Intrinsic mode entropy: An enhanced classification means for automated Greek Sign Language gesture recognition , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.