Parallel Signal Processing of a Wireless Pressure‐Sensing Platform Combined with Machine‐Learning‐Based Cognition, Inspired by the Human Somatosensory System

Inspired by the human somatosensory system, pressure applied to multiple pressure sensors is received in parallel and combined into a representative signal pattern, which is subsequently processed using machine learning. The pressure signals are combined using a wireless system, where each sensor is assigned a specific resonant frequency on the reflection coefficient (S11 ) spectrum, and the applied pressure changes the magnitude of the S11 pole with minimal frequency shift. This allows the differentiation and identification of the pressure applied to each sensor. The pressure sensor consists of polypyrrole-coated microstructured poly(dimethylsiloxane) placed on top of electrodes, operating as a capacitive sensor. The high dielectric constant of polypyrrole enables relatively high pressure-sensing performance. The coils are vertically stacked to enable the reader to receive the signals from all of the sensors simultaneously at a single location, analogous to the junction between neighboring primary neurons to a secondary neuron. Here, the stacking order is important to minimize the interference between the coils. Furthermore, convolutional neural network (CNN)-based machine learning is utilized to predict the applied pressure of each sensor from unforeseen S11 spectra. With increasing training, the prediction accuracy improves (with mean squared error of 0.12), analogous to humans' cognitive learning ability.

[1]  Zhenan Bao,et al.  A bioinspired flexible organic artificial afferent nerve , 2018, Science.

[2]  Franklin Bien,et al.  Wearable smart sensor systems integrated on soft contact lenses for wireless ocular diagnostics , 2017, Nature Communications.

[3]  Benjamin C. K. Tee,et al.  25th Anniversary Article: The Evolution of Electronic Skin (E‐Skin): A Brief History, Design Considerations, and Recent Progress , 2013, Advanced materials.

[4]  Xiaodong Chen,et al.  Skin‐Inspired Haptic Memory Arrays with an Electrically Reconfigurable Architecture , 2016, Advanced materials.

[5]  J. Craig,et al.  Neural Mechanisms of Tactile Motion Integration in Somatosensory Cortex , 2011, Neuron.

[6]  Oussama Khatib,et al.  A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics , 2018, Science Robotics.

[7]  Jukka Lekkala,et al.  Fabrication and Characterization of a Wireless Bioresorbable Pressure Sensor , 2019, Advanced Materials Technologies.

[8]  Stephen P. Boyd,et al.  Simple accurate expressions for planar spiral inductances , 1999, IEEE J. Solid State Circuits.

[9]  Huaqiang Wu,et al.  An artificial nociceptor based on a diffusive memristor , 2018, Nature Communications.

[10]  Hong Wang,et al.  Ionic Skin with Biomimetic Dielectric Layer Templated from Calathea Zebrine Leaf , 2018, Advanced Functional Materials.

[11]  Jonghwa Park,et al.  Flexible Ferroelectric Sensors with Ultrahigh Pressure Sensitivity and Linear Response over Exceptionally Broad Pressure Range. , 2018, ACS nano.

[12]  Zhong Lin Wang,et al.  Skin-inspired highly stretchable and conformable matrix networks for multifunctional sensing , 2018, Nature Communications.

[13]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[14]  Yuanwen Jiang,et al.  A wireless body area sensor network based on stretchable passive tags , 2019, Nature Electronics.

[15]  J. DiCarlo,et al.  Using goal-driven deep learning models to understand sensory cortex , 2016, Nature Neuroscience.

[16]  Xin Zhang,et al.  Tunable electrical and mechanical responses of PDMS and polypyrrole nanowire composites , 2013 .

[17]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[18]  Minoru Asada,et al.  Cognitive developmental robotics as a new paradigm for the design of humanoid robots , 2001, Robotics Auton. Syst..

[19]  J. Y. Sim,et al.  Microstructured Porous Pyramid-Based Ultrahigh Sensitive Pressure Sensor Insensitive to Strain and Temperature. , 2019, ACS applied materials & interfaces.

[20]  Zhenan Bao,et al.  Electronic Skin: Recent Progress and Future Prospects for Skin‐Attachable Devices for Health Monitoring, Robotics, and Prosthetics , 2019, Advanced materials.

[21]  H. Dinse,et al.  Superior tactile performance and learning in professional pianists: evidence for meta‐plasticity in musicians , 2004, The European journal of neuroscience.

[22]  M. Merzenich,et al.  Experience-Dependent Adult Cortical Plasticity Requires Cognitive Association between Sensation and Reward , 2006, Neuron.

[23]  Jong-Moo Lee,et al.  Circuit-Model-Based Analysis of a Wireless Energy-Transfer System via Coupled Magnetic Resonances , 2011, IEEE Transactions on Industrial Electronics.

[24]  Alexandra M. Fernandes,et al.  Tactual perception: a review of experimental variables and procedures , 2012, Cognitive Processing.

[25]  Ju Seung Lee,et al.  Controllable Configuration of Sensing Band in a Pressure Sensor by Lenticular Pattern Deformation on Designated Electrodes , 2019, Advanced materials.

[26]  Carsten Klingner,et al.  Parallel processing of somatosensory information: Evidence from dynamic causal modeling of MEG data , 2015, NeuroImage.

[27]  Alvaro Pascual-Leone,et al.  Cortical plasticity associated with Braille learning , 1998, Trends in Cognitive Sciences.

[28]  Friedrich T. Sommer,et al.  Learning and exploration in action-perception loops , 2013, Front. Neural Circuits.

[29]  Zhenan Bao,et al.  Pursuing prosthetic electronic skin. , 2016, Nature materials.

[30]  T. Wiesel,et al.  Receptive field dynamics in adult primary visual cortex , 1992, Nature.

[31]  Ellen A. Lumpkin,et al.  Mechanisms of sensory transduction in the skin , 2007, Nature.

[32]  H-S Philip Wong,et al.  Continuous wireless pressure monitoring and mapping with ultra-small passive sensors for health monitoring and critical care , 2014, Nature Communications.

[33]  Minjeong Ha,et al.  Wearable and flexible sensors for user-interactive health-monitoring devices. , 2018, Journal of materials chemistry. B.

[34]  Xiaodong Chen,et al.  An Artificial Sensory Neuron with Tactile Perceptual Learning , 2018, Advanced materials.

[35]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[36]  Stefan Wermter,et al.  Continual Lifelong Learning with Neural Networks: A Review , 2019, Neural Networks.

[37]  Hongwei Zhu,et al.  Recent advances in wearable tactile sensors: Materials, sensing mechanisms, and device performance , 2017 .

[38]  M. Bear,et al.  Metaplasticity: the plasticity of synaptic plasticity , 1996, Trends in Neurosciences.

[39]  Xunyu Lu,et al.  Electrodeposition of hierarchically structured three-dimensional nickel–iron electrodes for efficient oxygen evolution at high current densities , 2015, Nature Communications.