Simulating tactile signals from the whole hand with millisecond precision

Significance When we grasp an object, thousands of tactile nerve fibers become activated and inform us about its physical properties (e.g., shape, size, and texture). Although the properties of individual fibers have been described, our understanding of how object information is encoded in populations of fibers remains primitive. To fill this gap, we have developed a simulation of tactile fibers that incorporates much of what is known about skin mechanics and tactile nerve fibers. We show that simulated fibers match biological ones across a wide range of conditions sampled from the literature. We then show how this simulation can reveal previously unknown ways in which populations of nerve fibers cooperate to convey sensory information and discuss the implications for bionic hands. When we grasp and manipulate an object, populations of tactile nerve fibers become activated and convey information about the shape, size, and texture of the object and its motion across the skin. The response properties of tactile fibers have been extensively characterized in single-unit recordings, yielding important insights into how individual fibers encode tactile information. A recurring finding in this extensive body of work is that stimulus information is distributed over many fibers. However, our understanding of population-level representations remains primitive. To fill this gap, we have developed a model to simulate the responses of all tactile fibers innervating the glabrous skin of the hand to any spatiotemporal stimulus applied to the skin. The model first reconstructs the stresses experienced by mechanoreceptors when the skin is deformed and then simulates the spiking response that would be produced in the nerve fiber innervating that receptor. By simulating skin deformations across the palmar surface of the hand and tiling it with receptors at their known densities, we reconstruct the responses of entire populations of nerve fibers. We show that the simulated responses closely match their measured counterparts, down to the precise timing of the evoked spikes, across a wide variety of experimental conditions sampled from the literature. We then conduct three virtual experiments to illustrate how the simulation can provide powerful insights into population coding in touch. Finally, we discuss how the model provides a means to establish naturalistic artificial touch in bionic hands.

[1]  Vincent Hayward,et al.  Mechanical behavior of the fingertip in the range of frequencies and displacements relevant to touch. , 2012, Journal of biomechanics.

[2]  Dominique M. Durand,et al.  Selective recording of the canine hypoglossal nerve using a multicontact flat interface nerve electrode , 2005, IEEE Transactions on Biomedical Engineering.

[3]  R. Howe,et al.  Dynamic contact of the human fingerpad against a flat surface. , 1999, Journal of biomechanical engineering.

[4]  A. W. Schopper,et al.  A structural fingertip model for simulating of the biomechanics of tactile sensation. , 2004, Medical engineering & physics.

[5]  Hannes P. Saal,et al.  Touch is a team effort: interplay of submodalities in cutaneous sensibility , 2014, Trends in Neurosciences.

[6]  Maria Nolano,et al.  Quantification of myelinated endings and mechanoreceptors in human digital skin , 2003, Annals of neurology.

[7]  V. Mountcastle,et al.  The sense of flutter-vibration: comparison of the human capacity with response patterns of mechanoreceptive afferents from the monkey hand. , 1968, Journal of neurophysiology.

[8]  Benoit P. Delhaye,et al.  Key considerations in designing a somatosensory neuroprosthesis , 2016, Journal of Physiology-Paris.

[9]  R. Johansson,et al.  Sensitivity to edges of mechanoreceptive afferent units innervating the glabrous skin of the human hand , 1982, Brain Research.

[10]  Vernon B. Mountcastle,et al.  The Neural Transformation of Mechanical Stimuli Delivered to the Monkey's Hand , 2008 .

[11]  M. Paré,et al.  Distribution and terminal arborizations of cutaneous mechanoreceptors in the glabrous finger pads of the monkey , 2002, The Journal of comparative neurology.

[12]  V. Hayward,et al.  Finger pad friction and its role in grip and touch , 2013, Journal of The Royal Society Interface.

[13]  E. P. Gardner,et al.  Neuronal mechanisms underlying direction sensitivity of somatosensory cortical neurons in awake monkeys. , 1980, Journal of neurophysiology.

[14]  J. Craig,et al.  Texture perception through direct and indirect touch: An analysis of perceptual space for tactile textures in two modes of exploration , 2007, Somatosensory & motor research.

[15]  Stefan Mihalas,et al.  Does Afferent Heterogeneity Matter in Conveying Tactile Feedback Through Peripheral Nerve Stimulation? , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  I. N. Sneddon,et al.  The elastic stresses produced by the indentation of the plane surface of a semi-infinite elastic solid by a rigid punch , 1945, Mathematical Proceedings of the Cambridge Philosophical Society.

[17]  K. Johnson,et al.  Neural coding of tactile texture: comparison of spatial and temporal mechanisms for roughness perception , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  R. Johansson,et al.  Spatial properties of the population of mechanoreceptive units in the glabrous skin of the human hand , 1980, Brain Research.

[19]  Morten Kristian Haugland,et al.  Skin contact force information in sensory nerve signals recorded by implanted cuff electrodes , 1994 .

[20]  S. Bensmaia,et al.  A Variation Code Accounts for the Perceived Roughness of Coarsely Textured Surfaces , 2017, Scientific Reports.

[21]  J. F. Dammann,et al.  The Effect of Surface Wave Propagation on Neural Responses to Vibration in Primate Glabrous Skin , 2012, PloS one.

[22]  J. F. Dammann,et al.  The Neural Coding of Stimulus Intensity: Linking the Population Response of Mechanoreceptive Afferents with Psychophysical Behavior , 2007, The Journal of Neuroscience.

[23]  Hannes P. Saal,et al.  Rate and timing of cortical responses driven by separate sensory channels , 2015, eLife.

[24]  Kenneth O. Johnson,et al.  Spatiotemporal Receptive Fields of Peripheral Afferents and Cortical Area 3b and 1 Neurons in the Primate Somatosensory System , 2006, The Journal of Neuroscience.

[25]  Jeffrey M Yau,et al.  Neurophysiology of Tactile Perception : A Tribute to Steven Hsiao Feeling form : the neural basis of haptic shape perception , 2016 .

[26]  R. Johansson,et al.  First spikes in ensembles of human tactile afferents code complex spatial fingertip events , 2004, Nature Neuroscience.

[27]  Ernst Niebur,et al.  A simple model of mechanotransduction in primate glabrous skin. , 2013, Journal of neurophysiology.

[28]  Kenneth O. Johnson,et al.  A continuum mechanical model of mechanoreceptive afferent responses to indented spatial patterns. , 2006, Journal of neurophysiology.

[29]  Sethu Vijayakumar,et al.  Information about Complex Fingertip Parameters in Individual Human Tactile Afferent Neurons , 2009, The Journal of Neuroscience.

[30]  M. Keith,et al.  A neural interface provides long-term stable natural touch perception , 2014, Science Translational Medicine.

[31]  A. Goodwin,et al.  Peripheral Neural Mechanisms Determining the Orientation of Cylinders Grasped by the Digits , 1998, The Journal of Neuroscience.

[32]  A. Freeman,et al.  A model accounting for effects of vibratory amplitude on responses of cutaneous mechanoreceptors in macaque monkey , 1982, The Journal of physiology.

[33]  Mandayam A. Srinivasan,et al.  In vivo compressibility of the human fingertip , 1992 .

[34]  R. Johansson,et al.  Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. , 1984, Human neurobiology.

[35]  Benoit P. Delhaye,et al.  Texture-induced vibrations in the forearm during tactile exploration , 2012, Front. Behav. Neurosci..

[36]  Hannes P. Saal,et al.  Natural scenes in tactile texture. , 2014, Journal of neurophysiology.

[37]  M. Srinivasan,et al.  Encoding of shape and orientation of objects indented into the monkey fingerpad by populations of slowly and rapidly adapting mechanoreceptors. , 1998, Journal of neurophysiology.

[38]  R. Johansson,et al.  Responses of mechanoreceptive afferent units in the glabrous skin of the human hand to sinusoidal skin displacements , 1982, Brain Research.

[39]  Hannes P. Saal,et al.  Millisecond Precision Spike Timing Shapes Tactile Perception , 2012, The Journal of Neuroscience.

[40]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[41]  A. Goodwin,et al.  Slowly adapting type I afferents from the sides and end of the finger respond to stimuli on the center of the fingerpad. , 2000, Journal of neurophysiology.

[42]  C. Connor,et al.  Tactile roughness: neural codes that account for psychophysical magnitude estimates , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  J. F. Dammann,et al.  The Representation of Stimulus Orientation in the Early Stages of Somatosensory Processing , 2008, The Journal of Neuroscience.

[44]  Xiaoqin Wang,et al.  Importance of spike timing in touch: an analogy with hearing? , 2016, Current Opinion in Neurobiology.

[45]  K. O. Johnson,et al.  Tactile spatial resolution. II. Neural representation of Bars, edges, and gratings in monkey primary afferents. , 1981, Journal of neurophysiology.

[46]  Sung Soo Kim,et al.  Conveying Tactile Feedback in Sensorized Hand Neuroprostheses Using a Biofidelic Model of Mechanotransduction , 2009, IEEE Transactions on Biomedical Circuits and Systems.

[47]  G. J. Gerling SA-I mechanoreceptor position in fingertip skin may impact sensitivity to edge stimuli , 2010 .

[48]  R. Johansson,et al.  Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. , 1979, The Journal of physiology.

[49]  Mark C. W. van Rossum,et al.  A Novel Spike Distance , 2001, Neural Computation.

[50]  R. Johansson,et al.  Responses in glabrous skin mechanoreceptors during precision grip in humans , 2004, Experimental Brain Research.

[51]  A. Vallbo,et al.  Activity from skin mechanoreceptors recorded percutaneously in awake human subjects. , 1968, Experimental neurology.

[52]  K. O. Johnson,et al.  SA1 and RA receptive fields, response variability, and population responses mapped with a probe array. , 1999, Journal of neurophysiology.

[53]  J. Goldberg,et al.  Response of binaural neurons of dog superior olivary complex to dichotic tonal stimuli: some physiological mechanisms of sound localization. , 1969, Journal of neurophysiology.

[54]  Reid R. Harrison,et al.  Recording sensory and motor information from peripheral nerves with Utah Slanted Electrode Arrays , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  K. O. Johnson,et al.  Surround suppression in the responses of primate SA1 and RA mechanoreceptive afferents mapped with a probe array. , 1999, Journal of neurophysiology.

[56]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[57]  R. Johansson Tactile sensibility in the human hand: receptive field characteristics of mechanoreceptive units in the glabrous skin area. , 1978, The Journal of physiology.

[58]  C. D. Mote,et al.  A structural model of the forced compression of the fingertip pulp. , 1998, Journal of biomechanics.

[59]  K. O. Johnson,et al.  Tactile spatial resolution. III. A continuum mechanics model of skin predicting mechanoreceptor responses to bars, edges, and gratings. , 1981, Journal of neurophysiology.

[60]  Balasundar I Raju,et al.  3-D finite-element models of human and monkey fingertips to investigate the mechanics of tactile sense. , 2003, Journal of biomechanical engineering.

[61]  Hannes P. Saal,et al.  Biomimetic approaches to bionic touch through a peripheral nerve interface , 2015, Neuropsychologia.

[62]  A. Freeman,et al.  Cutaneous mechanoreceptors in macaque monkey: temporal discharge patterns evoked by vibration, and a receptor model , 1982, The Journal of physiology.

[63]  Vincent Hayward,et al.  Spatial patterns of cutaneous vibration during whole-hand haptic interactions , 2016, Proceedings of the National Academy of Sciences.

[64]  Arun P Sripati,et al.  Predicting the timing of spikes evoked by tactile stimulation of the hand. , 2010, Journal of neurophysiology.

[65]  J. A. Pruszynski,et al.  Edge-orientation processing in first-order tactile neurons , 2014, Nature Neuroscience.

[66]  Yoshichika Baba,et al.  Computation identifies structural features that govern neuronal firing properties in slowly adapting touch receptors , 2014, eLife.

[67]  M. Knibestöl Stimulus‐response functions of slowly adapting mechanoreceptors in the human glabrous skin area. , 1975, The Journal of physiology.

[68]  M. Knibestöl Stimulus—response functions of rapidly adapting mechanoreceptors in the human glabrous skin area , 1973, The Journal of physiology.

[69]  K. O. Johnson,et al.  Reconstruction of population response to a vibratory stimulus in quickly adapting mechanoreceptive afferent fiber population innervating glabrous skin of the monkey. , 1974, Journal of neurophysiology.

[70]  Aneesha K. Suresh,et al.  Edge orientation signals in tactile afferents of macaques. , 2016, Journal of neurophysiology.

[71]  Philippe Lefèvre,et al.  Surface strain measurements of fingertip skin under shearing , 2016, Journal of The Royal Society Interface.

[72]  M. Masen,et al.  Contact modelling of human skin: What value to use for the modulus of elasticity? , 2013 .

[73]  S S Hsiao,et al.  Spatial pattern representation and transformation in monkey somatosensory cortex. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[74]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[75]  David J. Warren,et al.  Using multiple high-count electrode arrays in human median and ulnar nerves to restore sensorimotor function after previous transradial amputation of the hand , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.