E-Jacket: Posture Detection with Loose-Fitting Garment using a Novel Strain Sensor

We address the problem of human posture detection with casual loose-fitting smart garments by fabricating a new type of highly sensitive, stretchable, optical transparent and low-cost strain sensor enabled by uniquely designed microcracks within a hybrid conductive thin film. In terms of sensitivity and stretchability, the developed sensor outperformed most of the works reported in recent literature, and has a gauge factor of 103 at the high strain of 58%. By attaching these sensors to an off-the-self casual jacket, we implement E-Jacket, a smart loose-fitting sensing garment prototype. To detect postures from sensor data, we implement a conventional deep learning model, CNN-LSTM, capable of overcoming the noise induced by the loose-fitting of the sensors to the human skin. To evaluate E-Jacket, we conducted three case studies in experimental environments: recognition of daily activities, recognition of stationary postures with random hand movements, and slouch detection. Our evaluation results demonstrate the feasibility of the proposed E-Jacket smart garment system for different posture recognition applications.

[1]  Babak Moradi,et al.  Compare of Machine Learning and Deep Learning Approaches for Human Activity Recognition , 2019, 2022 30th International Conference on Electrical Engineering (ICEE).

[2]  Deepak Ganesan,et al.  Fabric as a Sensor: Towards Unobtrusive Sensing of Human Behavior with Triboelectric Textiles , 2018, SenSys.

[3]  Shuhua Peng,et al.  Ultrasensitive and Stretchable Strain Sensors Based on Mazelike Vertical Graphene Network. , 2018, ACS applied materials & interfaces.

[4]  Shuhua Peng,et al.  Stretchable strain sensors based on PDMS composites with cellulose sponges containing one- and two-dimensional nanocarbons , 2018, Sensors and Actuators A: Physical.

[5]  Sajal K. Das,et al.  HARKE: Human Activity Recognition from Kinetic Energy Harvesting Data in Wearable Devices , 2018, IEEE Transactions on Mobile Computing.

[6]  Seunghoe Kim,et al.  Highly Sensitive Multifilament Fiber Strain Sensors with Ultrabroad Sensing Range for Textile Electronics. , 2018, ACS nano.

[7]  Juan José Pantrigo,et al.  Convolutional Neural Networks and Long Short-Term Memory for skeleton-based human activity and hand gesture recognition , 2018, Pattern Recognit..

[8]  Jian Zhou,et al.  Coaxial Thermoplastic Elastomer‐Wrapped Carbon Nanotube Fibers for Deformable and Wearable Strain Sensors , 2018 .

[9]  Bo Liedberg,et al.  Surface Strain Redistribution on Structured Microfibers to Enhance Sensitivity of Fiber‐Shaped Stretchable Strain Sensors , 2018, Advanced materials.

[10]  Choon-Gi Choi,et al.  High Durability and Waterproofing rGO/SWCNT-Fabric-Based Multifunctional Sensors for Human-Motion Detection. , 2018, ACS applied materials & interfaces.

[11]  Chenyang Zhao,et al.  Highly stretchable, sensitive strain sensors with a wide linear sensing region based on compressed anisotropic graphene foam/polymer nanocomposites. , 2017, Nanoscale.

[12]  Mahbub Hassan,et al.  A Survey of Wearable Devices and Challenges , 2017, IEEE Communications Surveys & Tutorials.

[13]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[14]  Lim Wei Yap,et al.  Percolating Network of Ultrathin Gold Nanowires and Silver Nanowires toward “Invisible” Wearable Sensors for Detecting Emotional Expression and Apexcardiogram , 2017 .

[15]  Chun H. Wang,et al.  Strain Sensors with Adjustable Sensitivity by Tailoring the Microstructure of Graphene Aerogel/PDMS Nanocomposites. , 2016, ACS applied materials & interfaces.

[16]  Qiang Liu,et al.  High-Performance Strain Sensors with Fish-Scale-Like Graphene-Sensing Layers for Full-Range Detection of Human Motions. , 2016, ACS nano.

[17]  Yong Lin,et al.  Highly stretchable and sensitive strain sensor based on graphene- elastomer composites with a novel double-interconnected network , 2016 .

[18]  Zhen Zhen,et al.  Structural engineering of gold thin films with channel cracks for ultrasensitive strain sensing , 2016 .

[19]  Huanyu Cheng,et al.  Large‐Area Ultrathin Graphene Films by Single‐Step Marangoni Self‐Assembly for Highly Sensitive Strain Sensing Application , 2016 .

[20]  Mehmet Turan,et al.  Parallel Microcracks-based Ultrasensitive and Highly Stretchable Strain Sensors. , 2016, ACS applied materials & interfaces.

[21]  Chun H. Wang,et al.  Aligning multilayer graphene flakes with an external electric field to improve multifunctional properties of epoxy nanocomposites , 2015 .

[22]  Chun Li,et al.  High-Quality Graphene Ribbons Prepared from Graphene Oxide Hydrogels and Their Application for Strain Sensors. , 2015, ACS nano.

[23]  Jidong Shi,et al.  Tactile Sensing System Based on Arrays of Graphene Woven Microfabrics: Electromechanical Behavior and Electronic Skin Application. , 2015, ACS nano.

[24]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[25]  Yuqing Chen,et al.  A Deep Learning Approach to Human Activity Recognition Based on Single Accelerometer , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[26]  Chun H. Wang,et al.  Improving the Toughness and Electrical Conductivity of Epoxy Nanocomposites by using Aligned Carbon Nanofibres , 2015 .

[27]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[28]  Jeong Sook Ha,et al.  Highly Stretchable and Sensitive Strain Sensors Using Fragmentized Graphene Foam , 2015 .

[29]  Chun H. Wang,et al.  Epoxy nanocomposites containing magnetite-carbon nanofibers aligned using a weak magnetic field , 2015 .

[30]  Sang-Gook Kim,et al.  Extremely Elastic Wearable Carbon Nanotube Fiber Strain Sensor for Monitoring of Human Motion. , 2015, ACS nano.

[31]  Woo Jin Hyun,et al.  Highly stretchable and wearable graphene strain sensors with controllable sensitivity for human motion monitoring. , 2015, ACS applied materials & interfaces.

[32]  Mauro Serpelloni,et al.  Wireless Wearable T-Shirt for Posture Monitoring During Rehabilitation Exercises , 2015, IEEE Transactions on Instrumentation and Measurement.

[33]  Prasant Misra,et al.  Cheepsync: a time synchronization service for resource constrained bluetooth le advertisers , 2015, IEEE Communications Magazine.

[34]  Chanseok Lee,et al.  Ultrasensitive mechanical crack-based sensor inspired by the spider sensory system , 2014, Nature.

[35]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[36]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[38]  Jonghwa Shin,et al.  Mussel‐Inspired Plasmonic Nanohybrids for Light Harvesting , 2014, Advanced materials.

[39]  I. Park,et al.  Highly stretchable and sensitive strain sensor based on silver nanowire-elastomer nanocomposite. , 2014, ACS nano.

[40]  Pooi See Lee,et al.  Graphene: Highly Stretchable Piezoresistive Graphene–Nanocellulose Nanopaper for Strain Sensors (Adv. Mater. 13/2014) , 2014 .

[41]  James P. Coughlin,et al.  Detecting bends and fabric folds using stitched sensors , 2013, ISWC '13.

[42]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[43]  Sung-hoon Ahn,et al.  A flexible and highly sensitive strain-gauge sensor using reversible interlocking of nanofibres. , 2012, Nature materials.

[44]  Congli He,et al.  Ultra-sensitive strain sensors based on piezoresistive nanographene films , 2012 .

[45]  Rui Zhang,et al.  Strain dependent resistance in chemical vapor deposition grown graphene , 2011 .

[46]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[47]  Gerhard Tröster,et al.  Estimating Posture-Recognition Performance in Sensing Garments Using Geometric Wrinkle Modeling , 2010, IEEE Transactions on Information Technology in Biomedicine.

[48]  Gerhard Tröster,et al.  Rapid prototyping of smart garments for activity-aware applications , 2009, J. Ambient Intell. Smart Environ..

[49]  Manfred Tscheligi,et al.  perFrames: Persuasive Picture Frames for Proper Posture , 2008, PERSUASIVE.

[50]  Gerhard Tröster,et al.  Recognizing Upper Body Postures using Textile Strain Sensors , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[51]  Blake Hannaford,et al.  "Are You with Me?" - Using Accelerometers to Determine If Two Devices Are Carried by the Same Person , 2004, Pervasive.

[52]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[53]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[54]  Sungwook Yu,et al.  Neck–tongue syndrome precipitated by prolonged poor sitting posture , 2013, Neurological Sciences.