Timing sensory integration for robot simulation of autistic behavior

UTISM is the most common condition in a group of developmental disorders known as the autism spectrum disorders (ASDs) [42]. It is characterized by impaired social interaction, problems with verbal and nonverbal communication, and unusual, repetitive, behaviors and interests. Movement disturbance symptoms in individuals with autism have long not been considered an important symptom. During the last decade, Leary and Hill [4] have offered a radical perspective on this subject. After thorough analysis of the bibliography on movement impairments in autism they outlined how deficits in movement preparation and execution could lead to many of the behaviors exhibited by individuals with autism. Difficulties in planning and executing simple discrete movements, can lead to problems in learning to coordinate diverse muscle groups into a unitary movement pattern. Moreover, when a person is unable to respond to another’s action in a timely fashion they will miss the positive reinforcement associated with interpersonal interaction. Behavioral evidence of human perception and action indicates that organisms make use of multisensory stimulation. Under normal circumstances, multisensory stimulation leads to enhanced perceptions of, and facilitated responses to, objects in the environment (e.g. [5][6][7]). But literature shows that imprecise grasping or other motor or executive dysfunctions observed in autistic patients are caused by a disturbance in a dynamic mechanism that involves multisensory processing and integration. This can be caused by discrepancies between stimuli that are normally concordant. In these circumstances, multisensory stimulation actually leads to inaccurate perceptions and responses, regarding location, identity, and timing. Temporal binding for instance is identified as a dynamic mechanism that is disrupted and likely implicated in the perceptual as well as higher order deficits observed in autism (Brock et al. [8]). In other studies, atypical processing is specifically associated with enhanced sensory processing or discrimination in various modalities [9][10][11]. Some studies argue for a broader neurological problem such as an executive function deficit in the coordination of sources of information from different modalities [12][13][14]. All these works suggest that the dynamic aspects of integration of multisensory input influences the forming of coherent perception, planning, and coordination of action. Even more concrete, many studies assume that simple motor planning is intact but that the use of externally guided visual feedback is diminished, affecting the quality of motor performance, postural stability, and the lack of effective sequencing of actions [15][16][17][18]. Thus, perceptually challenging tasks that require smooth integration of visual with vestibular-proprioceptive information, for example, may be particularly difficult to perform and could result in poor quality of motor performance on complex tasks. We test this assumption by simulating the dynamic mechanism of temporal multisensory integration in order to investigate how the atypical forming of coherent perception might influence coordination of action, and compare the results with experimental studies by typical and autistic patients. Temporal multisensory integration has previously been discussed in the context of autism in [8] [19] in attempts to obtain a clear understanding of the underlying biological mechanism of interaction and to simulate it in [20][21] in the robotics setting in [22][23], and implicitly in many other robotics studies. Masterton and Biederman [15] in particular have shown that a proper interplay between integration of distal (visual) and proximal (proprioceptive) cues is essential by grasping. We simulate the integration of these cues on a mobile robot in a two-dimensional plane. A very important point is that the integration process that causes the movement behavior is approximated by a dynamic mechanism. Proper modeling of dynamic (or temporal) integration mechanisms requires a dynamic neural model. The mainstream connectionist methods such as self-organizing or supervised feed-forward networks, and Hopfield type recurrent networks, produce static outputs because their internal dynamics lack feedback loops, and their input space is static. Therefore they are suitable for modeling static behaviors. We are interested in a neural system that can spontaneously exhibit several dynamic behaviors derived from the interaction between changing input and complex inner dynamics. However, for the sake of controllability and computational expense, we have chosen the model that requires the least complexity. Schöner and colleagues [2[2][23][24] have adapted the dynamic neural field model of Amari [1] for controlling mobile robots and robot-manipulators. It produces smooth behavioral trajectories satisfying more than one external variable. In this model the Timing sensory integration for robot simulation of autistic behavior

[1]  S. Bryson,et al.  Imitation and action in autism: a critical review. , 1994, Psychological bulletin.

[2]  Estela Bicho,et al.  The dynamic neural field approach to cognitive robotics , 2006, Journal of neural engineering.

[3]  Anne C. Sittig,et al.  The precision of proprioceptive position sense , 1998, Experimental Brain Research.

[4]  David L. Strayer,et al.  Executive function abilities in autism and Tourette syndrome: an information processing approach. , 1994, Journal of child psychology and psychiatry, and allied disciplines.

[5]  H.-M. Gross,et al.  Design and optimization of Amari neural fields for early auditory-visual integration , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[6]  S. Baron-Cohen,et al.  Enhanced discrimination of novel, highly similar stimuli by adults with autism during a perceptual learning task. , 1998, Journal of child psychology and psychiatry, and allied disciplines.

[7]  Ioannis Iossifidis,et al.  CONTROLLING AN 8 DOF MANIPULATOR BY MEANS OF NEURAL FIELDS , 2001 .

[8]  G. Schöner,et al.  Dynamic Field Theory of Movement Preparation , 2022 .

[9]  C. Deruelle,et al.  Motion and Emotion: A Novel Approach to the Study of Face Processing by Young Autistic Children , 2001, Journal of autism and developmental disorders.

[10]  M. Wiznitzer,et al.  AIDS and the Nervous System , 1988, Neurology.

[11]  Daniel Senkowski,et al.  Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations , 2007, Neuropsychologia.

[12]  Axel Steinhage THE DYNAMIC APPROACH TO ANTHROPOMORPHIC ROBOTICS , 2007 .

[13]  S. Niculescu Delay Effects on Stability: A Robust Control Approach , 2001 .

[14]  Tino Lourens,et al.  Event based self-supervised temporal integration for multimodal sensor data. , 2005, Journal of integrative neuroscience.

[15]  Caroline C Brown,et al.  The temporal binding deficit hypothesis of autism , 2002, Development and Psychopathology.

[16]  W. David Hairston,et al.  Altered temporal profile of visual–auditory multisensory interactions in dyslexia , 2005, Experimental Brain Research.

[17]  N. Bolognini,et al.  “Acoustical vision” of below threshold stimuli: interaction among spatially converging audiovisual inputs , 2004, Experimental Brain Research.

[18]  D. A. Hill,et al.  Moving on: autism and movement disturbance. , 1996, Mental retardation.

[19]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[20]  Paul J. Laurienti,et al.  Semantic congruence is a critical factor in multisensory behavioral performance , 2004, Experimental Brain Research.

[21]  Klaus Scheffler,et al.  Temporal integration of sequential auditory events: silent period in sound pattern activates human planum temporale , 2003, NeuroImage.

[22]  Gregor Schöner,et al.  Dynamics of behavior: Theory and applications for autonomous robot architectures , 1995, Robotics Auton. Syst..

[23]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[24]  E. Thelen,et al.  The dynamics of embodiment: A field theory of infant perseverative reaching , 2001, Behavioral and Brain Sciences.

[25]  Aude Billard,et al.  Biologically Inspired Multimodal Integration: Interferences in a Human-Robot Interaction Game , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Christian Faubel Fast learning to recognize objects : Dynamic Fields in label-feature spaces , 2006 .

[27]  B. Stein,et al.  Enhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis , 1996, Journal of Cognitive Neuroscience.

[28]  John McDonald,et al.  Sensory Integration and the Perceptual Experience of Persons with Autism , 2006, Journal of autism and developmental disorders.

[29]  Wendy L. Stone,et al.  Motor Imitation in Young Children with Autism: What's the Object? , 1997, Journal of abnormal child psychology.

[30]  P. Zelazo,et al.  Executive Function in Typical and Atypical Development , 2010 .

[31]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[32]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[33]  Yixin Diao,et al.  Feedback Control of Computing Systems , 2004 .

[34]  G. Calvert,et al.  Multisensory integration: methodological approaches and emerging principles in the human brain , 2004, Journal of Physiology-Paris.

[35]  G B Biederman,et al.  Proprioceptive versus visual control in autistic children , 1983, Journal of autism and developmental disorders.

[36]  Tara Flanagan,et al.  Deconstructing executive deficits among persons with autism: Implications for cognitive neuroscience , 2007, Brain and Cognition.

[37]  Robert Galambos,et al.  A Comparison of Certain Gamma Band (40-HZ) Brain Rhythms in Cat and Man , 1992 .

[38]  J. Burack,et al.  Enhanced perceptual functioning in the development of autism. , 2001 .

[39]  Shin'ya Nishida Interactions and Integrations of Multiple Sensory Channels in Human Brain , 2006, 2006 IEEE International Conference on Multimedia and Expo.