Robotic Homunculus: Learning of Artificial Skin Representation in a Humanoid Robot Motivated by Primary Somatosensory Cortex

Using the iCub humanoid robot with an artificial pressure-sensitive skin, we investigate how representations of the whole skin surface resembling those found in primate primary somatosensory cortex can be formed from local tactile stimulations traversing the body of the physical robot. We employ the well-known self-organizing map algorithm and introduce its modification that makes it possible to restrict the maximum receptive field (MRF) size of neuron groups at the output layer. This is motivated by findings from biology where basic somatotopy of the cortical sheet seems to be prescribed genetically and connections are localized to particular regions. We explore different settings of the MRF and the effect of activity-independent (input-output connections constraints implemented by MRF) and activity-dependent (learning from skin stimulations) mechanisms on the formation of the tactile map. The framework conveniently allows one to specify prior knowledge regarding the skin topology and thus to effectively seed a particular representation that training shapes further. Furthermore, we show that the MRF modification facilitates learning in situations when concurrent stimulation at nonadjacent places occurs (“multitouch”). The procedure was sufficiently robust and not intensive on the data collection and can be applied to any robots where representation of their “skin” is desirable.

[1]  Risto Miikkulainen,et al.  Cooperative self-organization of afferent and lateral connections in cortical maps , 1994, Biological Cybernetics.

[2]  Yann Boniface,et al.  Dynamic self-organising map , 2011, Neurocomputing.

[3]  Zhenan Bao,et al.  Pursuing prosthetic electronic skin. , 2016, Nature materials.

[4]  Helge J. Ritter,et al.  Flexible and stretchable fabric-based tactile sensor , 2015, Robotics Auton. Syst..

[5]  Alessandro Roncone,et al.  Peripersonal Space and Margin of Safety around the Body: Learning Visuo-Tactile Associations in a Humanoid Robot with Artificial Skin , 2016, PloS one.

[6]  E. G. Jones,et al.  Cortical and subcortical contributions to activity-dependent plasticity in primate somatosensory cortex. , 2000, Annual review of neuroscience.

[7]  I. Kaufman The Cerebral Cortex of Man: A Clinical Study of Localization of Function , 1951 .

[8]  C. Malsburg,et al.  How to label nerve cells so that they can interconnect in an ordered fashion. , 1977, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Matej Hoffmann,et al.  The encoding of proprioceptive inputs in the brain: knowns and unknowns from a robotic perspective , 2016, ArXiv.

[10]  L. Munari How the body shapes the way we think — a new view of intelligence , 2009 .

[11]  Fulvio Mastrogiovanni,et al.  Special issue on advances in tactile sensing and tactile-based human-robot interaction , 2015, Robotics Auton. Syst..

[12]  Nicolas P. Rougier,et al.  A Neural Field Model of the Somatosensory Cortex: Formation, Maintenance and Reorganization of Ordered Topographic Maps , 2012, PloS one.

[13]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[14]  Gordon Cheng,et al.  Realizing whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot , 2015, Adv. Robotics.

[15]  Klaus Pawelzik,et al.  Quantifying the neighborhood preservation of self-organizing feature maps , 1992, IEEE Trans. Neural Networks.

[16]  Y. Kuniyoshi,et al.  Modeling the Minimal Newborn's Intersubjective Mind: The Visuotopic-Somatotopic Alignment Hypothesis in the Superior Colliculus , 2013, PloS one.

[17]  C. Sherrington,et al.  OBSERVATIONS ON THE EXCITABLE CORTEX OF THE CHIMPANZEE, ORANG‐UTAN, AND GORILLA , 1917 .

[18]  Giorgio Metta,et al.  A Flexible and Robust Large Scale Capacitive Tactile System for Robots , 2013, IEEE Sensors Journal.

[19]  Klaus Schulten,et al.  Large-Scale Simulation of a Self-organizing Neural Network: Formation of a Somatotopic Map , 1989 .

[20]  Jean-Luc R Stevens,et al.  Mechanisms for Stable, Robust, and Adaptive Development of Orientation Maps in the Primary Visual Cortex , 2013, The Journal of Neuroscience.

[21]  Tom Stafford,et al.  Self-organisation can generate the discontinuities in the somatosensory map , 2007, Neurocomputing.

[22]  Yasuo Kuniyoshi,et al.  Tactile stimuli from amniotic fluid guides the development of somatosensory cortex with hierarchical structure using human fetus simulation , 2013, 2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[23]  H. Ritter,et al.  A principle for the formation of the spatial structure of cortical feature maps. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Fulvio Mastrogiovanni,et al.  Towards automated self-calibration of robot skin , 2010, 2010 IEEE International Conference on Robotics and Automation.

[25]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[26]  Alejandro Hernández Arieta,et al.  Body Schema in Robotics: A Review , 2010, IEEE Transactions on Autonomous Mental Development.

[27]  K. Dautenhahn,et al.  Generation of Tactile Maps for Artificial Skin , 2011, PloS one.

[28]  Gregory J. Gerling,et al.  Validating a Population Model of Tactile Mechanotransduction of Slowly Adapting Type I Afferents at Levels of Skin Mechanics, Single-Unit Response and Psychophysics , 2014, IEEE Transactions on Haptics.

[29]  Hannes P. Saal,et al.  Touch is a team effort: interplay of submodalities in cutaneous sensibility , 2014, Trends in Neurosciences.

[30]  J. Schouenborg,et al.  Action-Based Body Maps in the Spinal Cord Emerge from a Transitory Floating Organization , 2008, The Journal of Neuroscience.

[31]  Chiara Bartolozzi,et al.  Robots with a sense of touch. , 2016, Nature materials.

[32]  Y. Kuniyoshi,et al.  An Embodied Brain Model of the Human Foetus , 2016, Scientific Reports.

[33]  Fulvio Mastrogiovanni,et al.  Skin spatial calibration using force/torque measurements , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Gordon Cheng,et al.  3D surface reconstruction for robotic body parts with artificial skins , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Francisco Vega-Bermudez,et al.  Attention in the Somatosensory System , 2001 .

[36]  G. Gerstein,et al.  Networks with lateral connectivity. III. Plasticity and reorganization of somatosensory cortex. , 1996, Journal of neurophysiology.

[37]  D. Polani Measures for the organization of self-organizing maps , 2001 .

[38]  Giulio Sandini,et al.  The iCub humanoid robot: An open-systems platform for research in cognitive development , 2010, Neural Networks.

[39]  Allister F. McGuire,et al.  A skin-inspired organic digital mechanoreceptor , 2015, Science.

[40]  Ron D. Frostig,et al.  A mapping label required for normal scale of body representation in the cortex , 2000, Nature Neuroscience.

[41]  Philippe Gaussier,et al.  Neural learning of the topographic tactile sensory information of an artificial skin through a self-organizing map , 2015, Adv. Robotics.

[42]  M. Crair Neuronal activity during development: permissive or instructive? , 1999, Current Opinion in Neurobiology.

[43]  Nikolaos G. Tsagarakis,et al.  The Design of the iCub humanoid Robot , 2012, Int. J. Humanoid Robotics.

[44]  Yasuo Kuniyoshi,et al.  A human fetus development simulation: Self-organization of behaviors through tactile sensation , 2010, 2010 IEEE 9th International Conference on Development and Learning.

[45]  J.H. Kaas,et al.  How do features of sensory representations develop? , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[46]  W. Penfield,et al.  SOMATIC MOTOR AND SENSORY REPRESENTATION IN THE CEREBRAL CORTEX OF MAN AS STUDIED BY ELECTRICAL STIMULATION , 1937 .

[47]  M. Sur,et al.  Representations of the body surface in postcentral parietal cortex of Macaca fascicularis , 1980, The Journal of comparative neurology.

[48]  Uriel Martinez-Hernandez,et al.  Expressive touch: Control of robot emotional expression by touch , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[49]  Esa Alhoniemi,et al.  Publication 6 SelfOrganizing Map in Matlab: the SOM Toolbox , 1999 .

[50]  Aude Billard,et al.  A survey of Tactile Human-Robot Interactions , 2010, Robotics Auton. Syst..

[51]  Fulvio Mastrogiovanni,et al.  Towards the creation of tactile maps for robots and their use in robot contact motion control , 2015, Robotics Auton. Syst..

[52]  Gordon Cheng,et al.  Humanoid Multimodal Tactile-Sensing Modules , 2011, IEEE Transactions on Robotics.

[53]  J. Pearson,et al.  Plasticity in the organization of adult cerebral cortical maps: a computer simulation based on neuronal group selection , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.