A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification

Wearable devices have many applications ranging from health analytics to virtual and mixed reality interaction, to industrial training. For wearable devices to be practical, they must be responsive, deformable to fit the wearer, and robust to the user's range of motion. Signals produced by the wearable must also be informative enough to infer the precise physical state or activity of the user. Herein, a fully soft, wearable glove is developed, which is capable of real‐time hand pose reconstruction, environment sensing, and task classification. The design is easy to fabricate using low cost, commercial off‐the‐shelf items in a manner that is amenable to automated manufacturing. To realize such capabilities, resisitive and fluidic sensing technologies with machine learning neural architectures are merged. The glove is formed from a conductive knit which is strain sensitive, providing information through a network of resistance measurements. Fluidic sensing captured via pressure changes in fibrous sewn‐in flexible tubes, measuring interactions with the environment. The system can reconstruct user hand pose and identify sensory inputs such as holding force, object temperature, conductability, material stiffness, and user heart rate, all with high accuracy. The ability to identify complex environmentally dependent tasks, including held object identification and handwriting recognition is demonstrated.

[1]  Ozgur Atalay,et al.  Knitted Strain Sensors: Impact of Design Parameters on Sensing Properties , 2014, Sensors.

[2]  Ozgur Atalay,et al.  Textile-Based Weft Knitted Strain Sensors: Effect of Fabric Parameters on Sensor Properties , 2013, Sensors.

[3]  Wojciech Matusik,et al.  Learning the signatures of the human grasp using a scalable tactile glove , 2019, Nature.

[4]  Joanne M Wagner,et al.  Recovery of Grasp versus Reach in People with Hemiparesis Poststroke , 2006, Neurorehabilitation and neural repair.

[5]  Bernd Bickel,et al.  DefSense: Computational Design of Customized Deformable Input Devices , 2016, CHI.

[6]  Zhuo Kang,et al.  Ultrasensitive and stretchable resistive strain sensors designed for wearable electronics , 2017 .

[7]  Paul Lukowicz,et al.  Active Capacitive Sensing: Exploring a New Wearable Sensing Modality for Activity Recognition , 2010, Pervasive.

[8]  Zhenan Bao,et al.  Pursuing prosthetic electronic skin. , 2016, Nature materials.

[9]  Yanmin Zhu,et al.  Real-time hand gesture recognition with Kinect for playing racing video games , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[10]  Yuhao Liu,et al.  Lab-on-Skin: A Review of Flexible and Stretchable Electronics for Wearable Health Monitoring. , 2017, ACS nano.

[11]  J. A. Fishel,et al.  Sensing tactile microvibrations with the BioTac — Comparison with human sensitivity , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[12]  Olga Sorkine-Hornung,et al.  Deformation Capture via Soft and Stretchable Sensor Arrays , 2018, ACM Trans. Graph..

[13]  L Tian,et al.  Wearable sensors: modalities, challenges, and prospects. , 2018, Lab on a chip.

[14]  Rebecca K. Kramer,et al.  Hyperelastic pressure sensing with a liquid-embedded elastomer , 2010 .

[15]  Andrew W. Fitzgibbon,et al.  Online generative model personalization for hand tracking , 2017, ACM Trans. Graph..

[16]  Kevin Curran,et al.  Characteristics of a Piezo-Resistive Fabric Stretch Sensor Glove for Home-Monitoring of Rheumatoid Arthritis , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks Workshops.

[17]  S. Yao,et al.  Wearable multifunctional sensors using printed stretchable conductors made of silver nanowires. , 2014, Nanoscale.

[18]  Thomas Bauernhansl,et al.  Wear@Work – A New Approach for Data Acquisition Using Wearables , 2016 .

[19]  Jovan Popović,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH 2009.

[20]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[21]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[22]  Jakub Galka,et al.  Inertial Motion Sensing Glove for Sign Language Gesture Acquisition and Recognition , 2016, IEEE Sensors Journal.

[23]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[24]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Chelsea Knittel,et al.  Development of a Carbon Fiber Knitted Capacitive Touch Sensor , 2016 .

[26]  Olga Sorkine-Hornung,et al.  Interactive hand pose estimation using a stretch-sensing soft glove , 2019, ACM Trans. Graph..

[27]  Jan Vanfleteren,et al.  Flexible and stretchable electronics for wearable health devices , 2015 .

[28]  Du Guanglong,et al.  Markerless Kinect-Based Hand Tracking for Robot Teleoperation , 2012 .

[29]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[30]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[31]  José Luis Pons Rovira,et al.  Rehabilitation Robotics: a Wearable Exo-Skeleton for Tremor Assessment and Suppression , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[32]  Fumiya Iida,et al.  Multi-Functional Soft Strain Sensors for Wearable Physiological Monitoring , 2018, Sensors.

[33]  Surya Girinatha Nurzaman,et al.  SVAS3: Strain Vector Aided Sensorization of Soft Structures , 2014, Sensors.

[34]  Ozgur Atalay,et al.  Comparative study of the weft-knitted strain sensors , 2017 .

[35]  Carmel Majidi,et al.  Rapid Fabrication of Soft, Multilayered Electronics for Wearable Biomonitoring , 2016 .

[36]  Dermot Diamond,et al.  Textile-Based Wearable Sensors for Assisting Sports Performance , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.