Tactile Signatures and Hand Motion Intent Recognition for Wearable Assistive Devices

Within the field of robotics and autonomous systems where there is a human in the loop, intent recognition plays an important role. This is especially true for wearable assistive devices used for rehabilitation, particularly post-stroke recovery. This paper reports results on the use of tactile patterns to detect weak muscle contractions in the forearm while at the same time associating these patterns with the muscle synergies during different grips. To investigate this concept, a series of experiments with healthy participants were carried out using a tactile arm brace (TAB) on the forearm while performing four different types of grip. The expected force patterns were established by analysing the muscle synergies of the four grip types and the forearm physiology. The results showed that the tactile signatures of the forearm recorded on the TAB align with the anticipated force patterns. Furthermore, a linear separability of the data across all four grip types was identified. Using the TAB data, machine learning algorithms achieved a 99% classification accuracy. The TAB results were highly comparable to a similar commercial intent recognition system based on a surface electromyography (sEMG) sensing.

[1]  Greg Chance,et al.  Wearable Tactile Sensor Brace for Motion Intent Recognition in Upper-Limb Rehabilitation , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[2]  Greg Chance,et al.  Response Times of a Tactile Motion Intent Recognition System , 2018 .

[3]  Yongjin Zhou,et al.  An Individual Finger Gesture Recognition System Based on Motion-Intent Analysis Using Mechanomyogram Signal , 2017, Front. Neurol..

[4]  Guanglin Li,et al.  Increasing the robustness against force variation in EMG motion classification by common spatial patterns , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  C. Menon,et al.  Counting Grasping Action Using Force Myography: An Exploratory Study With Healthy Individuals , 2017, JMIR rehabilitation and assistive technologies.

[6]  Qing He,et al.  Motion intent recognition of individual fingers based on mechanomyogram , 2017, Pattern Recognit. Lett..

[7]  Jana Kosecka,et al.  Real-Time Classification of Hand Motions Using Ultrasound Imaging of Forearm Muscles , 2016, IEEE Transactions on Biomedical Engineering.

[8]  Hong Kai Yap,et al.  Design of a wearable FMG sensing system for user intent detection during hand rehabilitation with a soft robotic glove , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[9]  Gretchen A. Stevens,et al.  A century of trends in adult human height , 2016, eLife.

[10]  Antonio Krüger,et al.  EMPress: Practical Hand Gesture Classification with Wrist-Mounted EMG and Pressure Sensing , 2016, CHI.

[11]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..

[12]  Danica Kragic,et al.  The GRASP Taxonomy of Human Grasp Types , 2016, IEEE Transactions on Human-Machine Systems.

[13]  Claudio Castellini,et al.  Shape conformable high spatial resolution tactile bracelet for detecting hand and wrist activity , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[14]  Minho Lee,et al.  Human motion based intent recognition using a deep dynamic neural model , 2015, Robotics Auton. Syst..

[15]  Xinjun Sheng,et al.  Development of a Hybrid Surface EMG and MMG Acquisition System for Human Hand Motion Analysis , 2015, ICIRA.

[16]  Manfredo Atzori,et al.  Electromyography data for non-invasive naturally-controlled robotic hand prostheses , 2014, Scientific Data.

[17]  Carlo Menon,et al.  Control an exoskeleton for forearm rotation using FMG , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[18]  Claudio Castellini,et al.  A Comparative Analysis of Three Non-Invasive Human-Machine Interfaces for the Disabled , 2014, Front. Neurorobot..

[19]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Claudio Castellini,et al.  Using a high spatial resolution tactile sensor for intention detection , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[21]  I. Swain,et al.  A comparison between reported and ideal patient-to-therapist ratios for stroke rehabilitation , 2013 .

[22]  Kenneth Sundaraj,et al.  Mechanomyogram for Muscle Function Assessment: A Review , 2013, PloS one.

[23]  A. Stoica,et al.  Decoding static and dynamic arm and hand gestures from the JPL BioSleeve , 2013, 2013 IEEE Aerospace Conference.

[24]  Yoshiaki Hayashi,et al.  An EMG-Based Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  J. Kleim,et al.  Neural Plasticity: The Biological Substrate For Neurorehabilitation , 2010, PM & R : the journal of injury, function, and rehabilitation.

[26]  M. T. Tarata The Electromyogram and Mechanomyogram in Monitoring Neuromuscular Fatigue: Techniques, Results, Potential Use within the Dynamic Effort , 2009 .

[27]  W. Craelius,et al.  Pressure signature of forearm as predictor of grip force. , 2008, Journal of rehabilitation research and development.

[28]  Sam L. Phillips,et al.  Residual kinetic imaging: a versatile interface for prosthetic control , 2005, Robotica.

[29]  Takakazu Ishimatsu,et al.  Muscle stiffness sensor to control an assistance device for the disabled , 2004, Artificial Life and Robotics.

[30]  S. Kozin,et al.  Interosseous membrane anatomy and functional mechanics. , 2001, Clinical orthopaedics and related research.

[31]  J. Skahen,et al.  The interosseous membrane of the forearm: anatomy and function. , 1997, The Journal of hand surgery.

[32]  H Kinoshita,et al.  Grip posture and forces during holding cylindrical objects with circular grips. , 1996, Ergonomics.

[33]  H. Kinoshita,et al.  Contributions and co-ordination of individual fingers in multiple finger prehension. , 1995, Ergonomics.

[34]  J. Webster,et al.  External finger forces in submaximal five-finger static pinch prehension. , 1992, Ergonomics.

[35]  R. F. Ker,et al.  Ratios of cross-sectional areas of muscles and their tendons in a healthy human forearm. , 1991, Journal of anatomy.

[36]  H. Ranu,et al.  Therapeutic Exercise: Foundations and Techniques. 2nd Edn , 1992 .