A Supramodal Vibrissa Tactile and Auditory Model for Texture Recognition

Audition and touch endow spectral processing abilities allowing texture recognition and discrimination. Rat whiskers sensory system exhibits, as the cochlea, resonance property decomposing the signal over frequencies. Moreover, there exists strong psychophysical and biological interactions between auditory and somatosensory corteces concerning texture analysis. Inspired by these similarities, this paper introduce a "supramodal" model allowing both vibrissa tactile and auditory texture recognition. Two gammatone based resonant filterbanks are used for cochlea and whiskers array modeling. Each filterbank is then linked to a feature extraction algorithm, inspired by data recorded in the rats barrel cortex, and finally to a multilayer perceptron. Results clearly show the ability of the model for texture recognition in both auditory and tactile tuning. Moreover, recent studies suggest that this resonance property plays a role in texture discrimination. Experiments presented here provide elements in the direction of this resonance hypothesis.

[1]  Hiroshi Yokoi,et al.  An active artificial whisker array for texture discrimination , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[2]  M. Diamond,et al.  Whisker Vibration Information Carried by Rat Barrel Cortex Neurons , 2004, The Journal of Neuroscience.

[3]  M. A. Neimark,et al.  Vibrissa Resonance as a Transduction Mechanism for Tactile Encoding , 2003, The Journal of Neuroscience.

[4]  Edward Givelberg,et al.  A comprehensive three-dimensional model of the cochlea , 2003 .

[5]  Patrick Pirim,et al.  Tactile Texture Discrimination in the Robot-rat Psikharpax , 2010, BIOSIGNALS.

[6]  Christian Igel,et al.  Improving the Rprop Learning Algorithm , 2000 .

[7]  M. A. Neimark,et al.  Neural Correlates of Vibrissa Resonance Band-Pass and Somatotopic Representation of High-Frequency Stimuli , 2004, Neuron.

[8]  I. Pollack,et al.  Effects of Differentiation, Integration, and Infinite Peak Clipping upon the Intelligibility of Speech , 1948 .

[9]  Jeffrey M Yau,et al.  Textural timbre , 2009, Communicative & integrative biology.

[10]  Brian R Glasberg,et al.  Derivation of auditory filter shapes from notched-noise data , 1990, Hearing Research.

[11]  Aude Oliva,et al.  Detecting changes in real-world objects: The relationship between visual long-term memory and change blindness , 2009, Communicative & integrative biology.

[12]  Jean-Arcady Meyer,et al.  The Psikharpax project: towards building an artificial rat , 2005, Robotics Auton. Syst..

[13]  M. Andermann,et al.  Mechanical resonance enhances the sensitivity of the vibrissa sensory system to near-threshold stimuli , 2008, Brain Research.

[14]  M. Brecht,et al.  Functional architecture of the mystacial vibrissae , 1997, Behavioural Brain Research.

[15]  Richard F. Lyon,et al.  A computational model of filtering, detection, and compression in the cochlea , 1982, ICASSP.

[16]  John J. Foxe,et al.  Multisensory Integration: Frequency Tuning of Audio-Tactile Integration , 2009, Current Biology.

[17]  D. Simons,et al.  Biometric analyses of vibrissal tactile discrimination in the rat , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Richard M. Warren,et al.  Auditory perception : an analysis and synthesis , 2008 .

[19]  Malcolm Slaney,et al.  An Efficient Implementation of the Patterson-Holdsworth Auditory Filter Bank , 1997 .

[20]  Jean-Arcady Meyer,et al.  Elastomer-based tactile sensor array for the artificial rat Psikharpax , 2009 .

[21]  Anthony G. Pipe,et al.  Whiskerbot: A Robotic Active Touch System Modeled on the Rat Whisker Sensory System , 2007, Adapt. Behav..

[22]  J. F. Dammann,et al.  Temporal Frequency Channels Are Linked across Audition and Touch , 2009, Current Biology.

[23]  R. Patterson,et al.  Complex Sounds and Auditory Images , 1992 .

[24]  M. Hartmann,et al.  Mechanical Characteristics of Rat Vibrissae: Resonant Frequencies and Damping in Isolated Whiskers and in the Awake Behaving Animal , 2003, The Journal of Neuroscience.

[25]  S. Lederman.  Auditory Texture Perception , 1979, Perception.

[26]  M. Diamond,et al.  Spatial–Temporal Distribution of Whisker-Evoked Activity in Rat Somatosensory Cortex and the Coding of Stimulus Location , 2000, The Journal of Neuroscience.