IR Sensor-Based Gesture Control Wheelchair for Stroke and SCI Patients

This paper presents a novel and simple hand gesture recognition method to be used in rehabilitation of people who have mobility issues particularly stroke patients and patients with spinal cord injury (SCI). Keeping in mind the reach of such a system for a wider community of people with mobility issues, the proposed low-cost control device called gpaD-gesture pad provides an alternative solution to the joystick-based powered wheelchair control through hand gestures. In this method, IR sensors are used for identifying the simple gestures to control the powered wheelchair to move in any direction. In the proposed prototype system HanGes, a gesture pad that includes IR sensors, MCU and power management circuit is designed for gesture recognition and identification and a controller for driving motors is implemented. HanGes's design, implementation, the response time calculations of the system, testing, performance evaluation with stroke and SCI patients are discussed in detail. With the average success rate of gesture recognition above 99.25% and response time as comparable with that of commercially available joystick controlled wheelchair, HanGes could be a possible alternative to the existing ones. With extensive experiments that demonstrate the accuracy of the system, the user experience, testing with patients, and the implementation cost indicate the superiority of our system.

[1]  Thomas S. Huang,et al.  Gesture modeling and recognition using finite state machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[2]  Meeko M. K. Oishi,et al.  Notch filter and MPC for powered wheelchair operation under Parkinson's tremor , 2014, 2014 American Control Conference.

[3]  Rajat Garg,et al.  A smart mobility solution for physically challenged , 2009, 2009 IEEE International Conference on Vehicular Electronics and Safety (ICVES).

[4]  Bhiksha Raj,et al.  One-handed gesture recognition using ultrasonic Doppler sonar , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  G. Paraskevas,et al.  Clinical study of the factors affecting radioulnar deviation of the wrist joint , 2010, BMC musculoskeletal disorders.

[6]  Tuan Nghia Nguyen,et al.  Robust Neuro-Sliding Mode Multivariable Control Strategy for Powered Wheelchairs , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Yi Zhang,et al.  A novel intelligent wheelchair control system based on hand gesture recognition , 2011, The 2011 IEEE/ICME International Conference on Complex Medical Engineering.

[8]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Jun Rim Choi,et al.  TCAM based pattern matching technique for hand gesture recognition , 2013, 2013 International SoC Design Conference (ISOCC).

[10]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[11]  Iñaki Iturrate,et al.  Synchronous EEG brain-actuated wheelchair with automated navigation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  Masatoshi Ishikawa,et al.  Gesture recognition using laser-based tracking system , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[13]  J. Urena,et al.  IR sensor array configuration and signal processing for detecting obstacles in railways , 2004, Processing Workshop Proceedings, 2004 Sensor Array and Multichannel Signal.

[14]  Ching-Lung Chang,et al.  Kinect-based Powered Wheelchair Control System , 2013, 2013 4th International Conference on Intelligent Systems, Modelling and Simulation.

[15]  Mi-Ching Tsai,et al.  Synchronized motion control for 2D joystick-based electric wheelchair driven by two wheel motors , 2012, 2012 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[16]  Masayoshi Wada,et al.  A joystick type car drive interface for wheelchair users , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[17]  Songmin Jia,et al.  Multimodal intelligent wheelchair control based on fuzzy algorithm , 2012, 2012 IEEE International Conference on Information and Automation.

[18]  Hasan Al-Nashash,et al.  Spinal Cord Injury Detection and Monitoring Using Spectral Coherence , 2009, IEEE Transactions on Biomedical Engineering.

[19]  Mohammed Yeasin,et al.  Visual understanding of dynamic hand gestures , 2000, Pattern Recognit..

[20]  Shahrokh Valaee,et al.  A Novel Accelerometer-based Gesture Recognition System by , 2010 .

[21]  Chern-Sheng Lin,et al.  Powered Wheelchair Controlled by Eye-Tracking System , 2006 .

[22]  Yunhui Liu,et al.  2D Human Gesture Tracking and Recognition by the Fusion of MEMS Inertial and Vision Sensors , 2014, IEEE Sensors Journal.

[23]  Qiang Li,et al.  A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices , 2014, IEEE Transactions on Human-Machine Systems.

[24]  Yi Zhang,et al.  A novel intelligent wheelchair control approach based on head gesture recognition , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[25]  Aditya Ramamoorthy,et al.  Recognition of dynamic hand gestures , 2003, Pattern Recognit..

[26]  Maysam Ghovanloo,et al.  Using Unconstrained Tongue Motion as an Alternative Control Mechanism for Wheeled Mobility , 2009, IEEE Transactions on Biomedical Engineering.

[27]  Tao Lu.  A motion control method of intelligent wheelchair based on hand gesture recognition , 2013, 2013 IEEE 8th Conference on Industrial Electronics and Applications (ICIEA).

[28]  Anna K. Lekova,et al.  Hand gestures recognition based on lightweight evolving fuzzy clustering method , 2013, 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013).

[29]  Dipak Kumar Ghosh,et al.  A static hand gesture recognition algorithm using k-mean based radial basis function neural network , 2011, 2011 8th International Conference on Information, Communications & Signal Processing.

[30]  Mohamed S. Kamel,et al.  Understanding hand gestures using approximate graph matching , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Eunmi Choi,et al.  Hand gesture recognition algorithm based on grayscale histogram of the image , 2010, 2010 4th International Conference on Application of Information and Communication Technologies.

[32]  Rajesh Kannan Megalingam,et al.  'Gest-BOT' - A Highly Convenient Locomotive Solution for the Elderly and Physically Challenged , 2012, 2012 IEEE Global Humanitarian Technology Conference.

[33]  Xinyu Wang,et al.  Data glove gesture recognition based on an improved neural network , 2010, Proceedings of the 29th Chinese Control Conference.

[34]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[35]  Farhat Fnaiech,et al.  Intelligent joystick for controlling power wheelchair navigation , 2013, 3rd International Conference on Systems and Control.

[36]  Mu-Chun Su,et al.  A fuzzy rule-based approach to spatio-temporal hand gesture recognition , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[37]  A Chatterjee,et al.  A Microcontroller-Based IR Range Finder System With Dynamic Range Enhancement , 2010, IEEE Sensors Journal.

[38]  Ho-Sub Yoon,et al.  Hand gesture recognition using combined features of location, angle and velocity , 2001, Pattern Recognit..

[39]  Lotte N. S. Andreasen Struijk,et al.  Inductive tongue control of powered wheelchairs , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[40]  Luis Montesano,et al.  Towards an Intelligent Wheelchair System for Users With Cerebral Palsy , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Thomas S. Huang,et al.  Static Hand Gesture Recognition based on Local Orientation Histogram Feature Distribution Model , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[42]  Yoshiaki Shirai,et al.  Gesture based human-robot interaction using a frame based software platform , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[43]  Dongbing Gu,et al.  Kinect Enabled Monte Carlo Localisation for a Robotic Wheelchair , 2012, Frontiers of Intelligent Autonomous Systems.

[44]  Xiaoyan Wang,et al.  Hidden-Markov-Models-Based Dynamic Hand Gesture Recognition , 2012 .

[45]  Kyuwan Choi,et al.  A new, human-centered wheelchair system controlled by the EMG signal , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[46]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[47]  Jagdish Lal Raheja,et al.  Real-Time Robotic Hand Control Using Hand Gestures , 2010, 2010 Second International Conference on Machine Learning and Computing.

[48]  Saurav Kumar Singh,et al.  Design and implementation of navigation algorithm for intelligent racing car , 2010, INTERACT-2010.

[49]  Mohan M. Trivedi,et al.  Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-Based Approach and Evaluations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[50]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.