The Language of Glove: Wireless gesture decoder with low-power and stretchable hybrid electronics

This communication describes a glove capable of wirelessly translating the American Sign Language (ASL) alphabet into text displayable on a computer or smartphone. The key components of the device are strain sensors comprising a piezoresistive composite of carbon particles embedded in a fluoroelastomer. These sensors are integrated with a wearable electronic module consisting of digitizers, a microcontroller, and a Bluetooth radio. Finite-element analysis predicts a peak strain on the sensors of 5% when the knuckles are fully bent. Fatigue studies suggest that the sensors successfully detect the articulation of the knuckles even when bent to their maximal degree 1,000 times. In concert with an accelerometer and pressure sensors, the glove is able to translate all 26 letters of the ASL alphabet. Lastly, data taken from the glove are used to control a virtual hand; this application suggests new ways in which stretchable and wearable electronics can enable humans to interface with virtual environments. Critically, this system was constructed of components costing less than $100 and did not require chemical synthesis or access to a cleanroom. It can thus be used as a test bed for materials scientists to evaluate the performance of new materials and flexible and stretchable hybrid electronics.

[1]  Timothy O'Connor,et al.  Plasticization of PEDOT:PSS by Common Additives for Mechanically Robust Organic Solar Cells and Wearable Sensors , 2015 .

[2]  Luca Maria Gambardella,et al.  Human Control of UAVs using Face Pose Estimates and Hand Gestures , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  Aaron P. Gerratt,et al.  Elastomeric Electronic Skin for Prosthetic Tactile Sensation , 2015 .

[4]  T. Someya,et al.  Stretchable, Large‐area Organic Electronics , 2010, Advanced materials.

[5]  Hao Wang,et al.  Antibacterial properties of hemp hurd powder against E. coli , 2015 .

[6]  I. Park,et al.  Highly stretchable and sensitive strain sensor based on silver nanowire-elastomer nanocomposite. , 2014, ACS nano.

[7]  M. R. Pereira,et al.  Polymer–filler interactions and mechanical properties of a polyurethane elastomer , 2000 .

[8]  H. Floyd Davis,et al.  A Low-Cost Quantitative Absorption Spectrophotometer , 2012 .

[9]  Daniel T H Lai,et al.  Tattoolike Polyaniline Microparticle-Doped Gold Nanowire Patches as Highly Durable Wearable Sensors. , 2015, ACS applied materials & interfaces.

[10]  Ting Wang,et al.  Flexible Transparent Electronic Gas Sensors. , 2016, Small.

[11]  K. Hata,et al.  A stretchable carbon nanotube strain sensor for human-motion detection. , 2011, Nature nanotechnology.

[12]  Daniel M. Vogt,et al.  Embedded 3D Printing of Strain Sensors within Highly Stretchable Elastomers , 2014, Advanced materials.

[13]  G. Whitesides,et al.  Soft Lithography. , 1998, Angewandte Chemie.

[14]  L. Maletsky,et al.  Accuracy of an optical active-marker system to track the relative motion of rigid bodies. , 2007, Journal of biomechanics.

[15]  Martin Burger,et al.  The iteratively regularized Gauss–Newton method with convex constraints and applications in 4Pi microscopy , 2011, 1106.5812.

[16]  H. Zahouani,et al.  In vivo measurements of the elastic mechanical properties of human skin by indentation tests. , 2008, Medical engineering & physics.

[17]  Ehud Sharlin,et al.  Three dimensional tangible user interface for controlling a robotic team , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[19]  Insang You,et al.  Material approaches to stretchable strain sensors. , 2015, Chemphyschem : a European journal of chemical physics and physical chemistry.

[20]  Pooi See Lee,et al.  Highly Stretchable Piezoresistive Graphene–Nanocellulose Nanopaper for Strain Sensors , 2014, Advanced materials.

[21]  A. Darzi,et al.  The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. , 2001, Journal of the American College of Surgeons.

[22]  Tahmina Akter,et al.  Reversibly stretchable transparent conductive coatings of spray-deposited silver nanowires. , 2012, ACS applied materials & interfaces.

[23]  Todd P. Coleman,et al.  Stretchable and flexible adhesive-integrated antenna for biomedical applications , 2016, 2016 IEEE International Symposium on Antennas and Propagation (APSURSI).

[24]  Huosheng Hu,et al.  Use of multiple wearable inertial sensors in upper limb motion tracking. , 2008, Medical engineering & physics.

[25]  Yonggang Huang,et al.  Silicon nanomembranes for fingertip electronics , 2012, Nanotechnology.

[26]  Jacques Marescaux,et al.  Transatlantic robot-assisted telesurgery , 2001, Nature.

[27]  Jacob J. Adams,et al.  Handwritten, Soft Circuit Boards and Antennas Using Liquid Metal Nanoparticles. , 2015, Small.

[28]  Dong Jun Lee,et al.  Transparent and Stretchable Interactive Human Machine Interface Based on Patterned Graphene Heterostructures , 2015 .

[29]  Scott M Husson,et al.  Membrane adsorbers comprising grafted glycopolymers for targeted lectin binding. , 2015, Journal of applied polymer science.

[30]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[31]  Alex A. Volinsky,et al.  Nanoindentation study of polydimethylsiloxane elastic modulus using Berkovich and flat punch tips , 2015 .

[32]  James A. Johnson,et al.  Accuracy of an electromagnetic tracking device: a study of the optimal range and metal interference. , 1996, Journal of biomechanics.

[33]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[34]  Zoltan Major,et al.  Cost-Efficient Open Source Desktop Size Radial Stretching System With Force Sensor , 2015, IEEE Access.