Optical Fiber Force Myography Sensor for Identification of Hand Postures

A low-cost optical fiber force myography sensor for noninvasive hand posture identification is proposed. The transducers are comprised of 10 mm periodicity silica multimode fiber microbending devices mounted in PVC plates, providing 0.05 N−1 sensitivity over ~20 N range. Next, the transducers were attached to the user forearm by means of straps in order to monitor the posterior proximal radial, the anterior medial ulnar, and the posterior distal radial muscles, and the acquired FMG optical signals were correlated to the performed gestures using a 5 hidden layers, 20-neuron artificial neural network classifier with backpropagation architecture, followed by a competitive layer. The overall results for 9 postures and 6 subjects indicated a 98.4% sensitivity and 99.7% average accuracy, being comparable to the electromyographic approaches. Moreover, in contrast to the current setups, the proposed methodology allows the identification of poses characterized by different configurations of fingers and wrist joint displacements with the utilization of only 3 transducers and a simple interrogation scheme, being suitable to further applications in human-computer interfaces.

[1]  C. K. Suzuki,et al.  Optical Fiber Specklegram Sensor for Measurement of Force Myography Signals , 2017, IEEE Sensors Journal.

[2]  Toshio Tsuji,et al.  A human-assisting manipulator teleoperated by EMG signals and arm motions , 2003, IEEE Trans. Robotics Autom..

[3]  M. Goldfarb,et al.  A Method for the Control of Multigrasp Myoelectric Prosthetic Hands , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  J. Mogk,et al.  The effects of posture on forearm muscle loading during gripping , 2003, Ergonomics.

[5]  Xu Zhang,et al.  Multiple Hand Gesture Recognition Based on Surface EMG Signal , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[6]  R. Clement,et al.  Bionic prosthetic hands: A review of present technology and future aspirations. , 2011, The surgeon : journal of the Royal Colleges of Surgeons of Edinburgh and Ireland.

[7]  Claudio Castellini,et al.  Optical Myography: Detecting Finger Movements by Looking at the Forearm , 2016, Front. Neurorobot..

[8]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[9]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[10]  C. K. Suzuki,et al.  Flexible Optical Fiber Bending Transducer for Application in Glove-Based Sensors , 2014, IEEE Sensors Journal.

[11]  Dapeng Yang,et al.  Combined Use of FSR Sensor Array and SVM Classifier for Finger Motion Recognition Based on Pressure Distribution Map , 2012 .

[12]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[13]  Claudio Castellini,et al.  A Comparative Analysis of Three Non-Invasive Human-Machine Interfaces for the Disabled , 2014, Front. Neurorobot..

[14]  Hong Liu,et al.  Classification of Multiple Finger Motions During Dynamic Upper Limb Movements , 2017, IEEE Journal of Biomedical and Health Informatics.

[15]  B. Culshaw,et al.  Optical fiber sensor technologies: opportunities and-perhaps-pitfalls , 2004, Journal of Lightwave Technology.

[16]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[17]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Y. Zheng,et al.  Sonomyography: monitoring morphological changes of forearm muscles in actions with the feasibility for the control of powered prosthesis. , 2006, Medical engineering & physics.

[19]  F. Pirotte,et al.  Optical Fiber Sensors Embedded Into Medical Textiles for Healthcare Monitoring , 2008, IEEE Sensors Journal.

[20]  Anton Filatov,et al.  Static and cyclic performance evaluation of sensors for human interface pressure measurement , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Thomas Schmitz-Rode,et al.  Surface electromyography and muscle force: limits in sEMG-force relationship and new approaches for applications. , 2009, Clinical biomechanics.

[22]  Michelle Mielke,et al.  Mechanomyographic amplitude and frequency responses during dynamic muscle actions: a comprehensive review , 2005, Biomedical engineering online.

[23]  Mircea Nicolescu,et al.  Vision-based hand pose estimation: A review , 2007, Comput. Vis. Image Underst..

[24]  Eric Fujiwara,et al.  Optical fiber specklegram sensor analysis by speckle pattern division. , 2017, Applied optics.

[25]  Eric Fujiwara,et al.  Development of a tactile sensor based on optical fiber specklegram analysis and sensor data fusion technique , 2017 .

[26]  G. M. Lyons,et al.  Finite state control of functional electrical stimulation for the rehabilitation of gait , 2000, Medical and Biological Engineering and Computing.

[27]  José Antonio Lozano,et al.  Sensitivity Analysis of k-Fold Cross Validation in Prediction Error Estimation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Panagiotis K. Artemiadis,et al.  Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography , 2014, Front. Neurorobot..

[29]  J. W. Berthold,et al.  Historical review of microbend fiber-optic sensors , 1995 .

[30]  Eric Rohmer,et al.  Optical fiber force myography sensor for applications in prosthetic hand control , 2018, 2018 IEEE 15th International Workshop on Advanced Motion Control (AMC).

[31]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[32]  W P Cooney,et al.  Flexor tendon forces: in vivo measurements. , 1992, The Journal of hand surgery.

[33]  Carlo Menon,et al.  Towards the development of a wearable feedback system for monitoring the activities of the upper-extremities , 2014, Journal of NeuroEngineering and Rehabilitation.

[34]  William Craelius,et al.  The bionic man: restoring mobility. , 2002, Science.

[35]  Eric Fujiwara,et al.  Optical myography system for posture monitoring , 2016, 2016 IEEE International Symposium on Consumer Electronics (ISCE).

[36]  Mamun Bin Ibne Reaz,et al.  Surface Electromyography Signal Processing and Classification Techniques , 2013, Sensors.

[37]  Fredrik Rehnmark,et al.  Robonaut: NASA's Space Humanoid , 2000, IEEE Intell. Syst..