A 3-D finger motion measurement system via soft strain sensors for hand rehabilitation

Abstract Finger mobility plays a crucial role in everyday lives and is especially a leading indicator during hand rehabilitation and assistance tasks. In this study, a soft sensor-based three-dimensional (3-D) finger motion measurement system is proposed. Specifically, we report the use of a soft rope-embedded microfluidic sensor with high sensitivity and responsivity for strain sensing in the proposed system. These microfluidic strain sensors are proved to have the advantages of being easy to fabricate, chemically inert, with low hysteresis and good flexibility in their output signals. Besides, kinematic modeling of different finger joints are also provided to investigate the reasonable sensor locations for obtaining accurate measurements. Algorithms to identify the varied non-coplanar motions (abduction/adduction and flexion/extension joint angles) are presented by means of tracking the locations of the first metacarpal bone in multiple thumb postures. As a demonstration of their potential, the rope-embedded strain sensing units were used as curvature sensors mounted on the dorsum of target joints. The soft sensor-based 3-D finger motion measurement system and algorithms are experimentally verified by comparison with a camera-based motion capture device. Placing sensors at the optimal locations, joint angle measurement can reach up

[1]  Chris Harris,et al.  Markerless Motion Capture and Measurement of Hand Kinematics: Validation and Application to Home-Based Upper Limb Rehabilitation , 2013, IEEE Transactions on Biomedical Engineering.

[2]  A. Buryanov,et al.  Proportions of Hand Segments , 2010 .

[3]  Jennifer C. Case,et al.  Multi-mode strain and curvature sensors for soft robotic applications , 2017 .

[4]  David Zhang,et al.  A Novel Medical E-Nose Signal Analysis System , 2017, Sensors.

[5]  Paul W. Brand,et al.  Clinical mechanics of the hand , 1985 .

[6]  Edward L. White,et al.  Fabric sensory sleeves for soft robot state estimation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[7]  L. M. Myers,et al.  The axes of rotation of the thumb carpometacarpal joint , 1992, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[8]  Ross A. Knepper,et al.  A Helping Hand: Soft Orthosis with Integrated Optical Strain Sensors and EMG Control , 2016, IEEE Robotics & Automation Magazine.

[9]  Marcel Rooze,et al.  A novel method for in-vivo evaluation of finger kinematics including definition of healthy motion patterns. , 2016, Clinical biomechanics.

[10]  Aaron P. Gerratt,et al.  Elastomeric Electronic Skin for Prosthetic Tactile Sensation , 2015 .

[11]  Sanlin S. Robinson,et al.  Highly stretchable electroluminescent skin for optical signaling and tactile sensing , 2016, Science.

[12]  Fan Liu,et al.  [The application of three dimensional analysis system in measuring rotation angles of thumb carpometacarpal joints]. , 2006, Zhonghua wai ke za zhi [Chinese journal of surgery].

[13]  Yiwei Tao,et al.  Wearable soft artificial skin for hand motion detection with embedded microfluidic strain sensing , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  B. Ziaie,et al.  A multiaxial stretchable interconnect using liquid-alloy-filled elastomeric microchannels , 2008 .

[15]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[16]  Huichan Zhao,et al.  Flexible and stretchable sensors for fluidic elastomer actuated soft robots , 2017 .

[17]  Youngmo Han.  A low-cost visual motion data glove as an input device to interpret human hand gestures , 2010, IEEE Transactions on Consumer Electronics.

[18]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[19]  Rebecca K. Kramer,et al.  Hyperelastic pressure sensing with a liquid-embedded elastomer , 2010 .

[20]  G. Whitesides,et al.  Eutectic Gallium‐Indium (EGaIn): A Liquid Metal Alloy for the Formation of Stable Structures in Microchannels at Room Temperature , 2008 .

[21]  Kristofer S. J. Pister,et al.  Acceleration sensing glove (ASG) , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[22]  Thomas Plötz,et al.  Optimising sampling rates for accelerometer-based human activity recognition , 2016, Pattern Recognit. Lett..

[23]  Nancy A Baker,et al.  Measurements of wrist and finger postures: a comparison of goniometric and motion capture techniques. , 2007, Journal of applied biomechanics.

[24]  Giovanni Saggio,et al.  A data glove based sensor interface to expressively control musical processes , 2011, 2011 4th IEEE International Workshop on Advances in Sensors and Interfaces (IWASI).

[25]  Rebecca K. Kramer,et al.  Low‐Cost, Facile, and Scalable Manufacturing of Capacitive Sensors for Soft Systems , 2017 .

[26]  Radhika Nagpal,et al.  Design and control of a bio-inspired soft wearable robotic device for ankle–foot rehabilitation , 2014, Bioinspiration & biomimetics.

[27]  Suin Kim,et al.  A Soft Sensor-Based Three-Dimensional (3-D) Finger Motion Measurement System , 2017, Sensors.

[28]  Robert J. Wood,et al.  Toward a modular soft sensor-embedded glove for human hand motion and tactile pressure measurement , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  John Z Wu,et al.  Kinematic performance of a six degree-of-freedom hand model (6DHand) for use in occupational biomechanics. , 2011, Journal of biomechanics.

[30]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[31]  Giancarlo Canavese,et al.  Flexible Tactile Sensing Based on Piezoresistive Composites: A Review , 2014, Sensors.

[32]  Cagdas D. Onal,et al.  A composite soft bending actuation module with integrated curvature sensing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Daniel M. Vogt,et al.  Embedded 3D Printing of Strain Sensors within Highly Stretchable Elastomers , 2014, Advanced materials.

[34]  Carmel Majidi,et al.  Enhanced performance of microfluidic soft pressure sensors with embedded solid microspheres , 2016 .

[35]  Toshihiro Itoh,et al.  Thin-film flexible sensor for omnidirectional strain measurements , 2017 .

[36]  Huichan Zhao,et al.  Curvature control of soft orthotics via low cost solid-state optics , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[37]  Enzo Pasquale Scilingo,et al.  Strain sensing fabric for hand posture and gesture monitoring , 2005, IEEE Transactions on Information Technology in Biomedicine.

[38]  Zheng Wang,et al.  A soft stretchable bending sensor and data glove applications , 2016, Robotics and biomimetics.

[39]  Sang Wook Lee,et al.  Improving Kinematic Accuracy of Soft Wearable Data Gloves by Optimizing Sensor Locations , 2016, Sensors.

[40]  Lucia Rita Quitadamo,et al.  Resistive flex sensors: a survey , 2015 .

[41]  J. Landsmeer.  The anatomy of the dorsal aponeurosis of the human finger and its functional significance , 1949, The Anatomical record.

[42]  Oliver Brand,et al.  3D‐Integrated and Multifunctional All‐Soft Physical Microsystems Based on Liquid Metal for Electronic Skin Applications , 2018 .

[43]  Fumiya Iida,et al.  Localized differential sensing of soft deformable surfaces , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Zhexin Xie,et al.  A eutectic-alloy-infused soft actuator with sensing, tunable degrees of freedom, and stiffness properties , 2018 .

[45]  Kaspar Althoefer,et al.  An optical curvature sensor for flexible manipulators , 2013, 2013 IEEE International Conference on Robotics and Automation.

[46]  Yonggwan Won,et al.  A summative scoring system for evaluation of human kinematic performance , 2016, Biomed. Signal Process. Control..

[47]  Andrew W. Fitzgibbon,et al.  Accurate, Robust, and Flexible Real-time Hand Tracking , 2015, CHI.

[48]  Richard W. Bohannon,et al.  Clinical measurement of range of motion. Review of goniometry emphasizing reliability and validity. , 1987, Physical therapy.

[49]  Shwetak N. Patel,et al.  Finexus: Tracking Precise Motions of Multiple Fingertips Using Magnetic Sensing , 2016, CHI.

[50]  Tomohiro Kuroda,et al.  Consumer price data-glove for sign language recognition , 2004 .

[51]  Yong-Lae Park,et al.  Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors , 2012, IEEE Sensors Journal.

[52]  Agnès Roby-Brami,et al.  Quantification of Finger-Tapping Angle Based on Wearable Sensors , 2017, Sensors.

[53]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[54]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[55]  Giulio Sandini,et al.  An embedded artificial skin for humanoid robots , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[56]  Hyung-Soon Park,et al.  Thumb joint angle estimation for soft wearable hand robotic devices , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[57]  G. Tröster,et al.  Sensor for Measuring Strain in Textile , 2008, Sensors.

[58]  Gui Yun Tian,et al.  A Fieldbus-based intelligent sensor , 2000 .

[59]  Yei Hwan Jung,et al.  Stretchable silicon nanoribbon electronics for skin prosthesis , 2014, Nature Communications.

[60]  R. L. Linscheid,et al.  The kinesiology of the thumb trapeziometacarpal joint. , 1981, The Journal of bone and joint surgery. American volume.