Simultaneity in Perception of Knocking

-“Knock, knock-who's there?” Here, we do not address this question but rather the underlying mechanism behind the perception of knocking impacts. When one knocks on a surface, her hand makes a forward-backward motion and, at the point of reversal, the knuckles collide with the rigid surface. How does one perceive the unity, or simultaneity, of the sensory events associated with this impact? Does this binding derive from a temporal estimate of simultaneity, or does the brain use some other mechanism? In this paper, we ask whether the tap and the reversal of the hand are perceived as happening together, since both took place at the same time or at a particular state of motion. The aim of this research is to find out whether a tactile event and the flow of proprioceptive information regarding the state of the arm are matched within the central nervous system according to time or state. We tested this experimentally with subjects who actively moved one arm, as well as subjects who were servoed by a robotic device. Our results suggest that time is the mechanism used for judging the unity of the modalities for both active and passive movements. Taken together, these results provide a useful cue for neuroscientists as to the structure and function of the perceptual and motor systems and essential engineering knowledge for the development of effective and realistic augmented reality systems with haptics for the telerobotics, telesurgery, and telepresence applications of the future.

[1]  Felix G. Hamza-Lup,et al.  The effects of network delay on task performance in a visual-haptic collaborative environment , 2009, ACM-SE 47.

[2]  Jörn Diedrichsen,et al.  Dissociating Timing and Coordination as Functions of the Cerebellum , 2007, The Journal of Neuroscience.

[3]  Elizabeth Torres,et al.  Space-time separation during obstacle-avoidance learning in monkeys. , 2006, Journal of neurophysiology.

[4]  P. Montague,et al.  Motor-Sensory Recalibration Leads to an Illusory Reversal of Action and Sensation , 2006, Neuron.

[5]  Ferdinando A. Mussa-Ivaldi,et al.  Perception of Delayed Stiffness , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[6]  Xin-Yuan Song,et al.  Model comparison of generalized linear mixed models , 2006, Statistics in medicine.

[7]  S. Kitazawa,et al.  Bayesian calibration of simultaneity in tactile temporal order judgment , 2006, Nature Neuroscience.

[8]  L. Harris,et al.  Simultaneity constancy: detecting events with touch and vision , 2005, Experimental Brain Research.

[9]  Mark A. Symmons,et al.  Active versus passive touch in three dimensions , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[10]  Antonio Bicchi,et al.  Does active exploration suppress tactile flow perception? , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[11]  Rodney X. Sturdivant,et al.  Applied Logistic Regression: Hosmer/Applied Logistic Regression , 2005 .

[12]  Jean-Jacques E. Slotine,et al.  Telemanipulation with Time Delays , 2004, Int. J. Robotics Res..

[13]  L. Harris,et al.  Simultaneity Constancy , 2004, Perception.

[14]  S. Nishida,et al.  Recalibration of audiovisual simultaneity , 2004, Nature Neuroscience.

[15]  Ingrid M. L. C. Vogels,et al.  Detection of Temporal Delays in Visual-Haptic Interfaces , 2004, Hum. Factors.

[16]  Wai Yu,et al.  Haptic virtual environment performance over IP networks: a case study , 2003, Proceedings Seventh IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[17]  Ferdinando A. Mussa-Ivaldi,et al.  Sequence, time, or state representation: how does the motor control system adapt to variable environments? , 2003, Biological Cybernetics.

[18]  S. Nishida,et al.  Marker Correspondence, Not Processing Latency, Determines Temporal Binding of Visual Attributes , 2002, Current Biology.

[19]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[20]  James V. Stone,et al.  When is now? Perception of simultaneity , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  M. Goodale,et al.  Active manual control of object views facilitates visual recognition , 1999, Current Biology.

[22]  A. G. Witney,et al.  Predictive motor learning of temporal delays. , 1999, Journal of neurophysiology.

[23]  F A Mussa-Ivaldi,et al.  Central representation of time during motor learning. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[24]  S. Zeki,et al.  A direct demonstration of perceptual asynchrony in vision , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[25]  R. Ivry.  The representation of temporal information in perception and motor control , 1996, Current Opinion in Neurobiology.

[26]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  K. O. Johnson,et al.  Human tactile pattern recognition: active versus passive touch, velocity effects, and patterns of confusion. , 1991, Journal of neurophysiology.

[28]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[29]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[30]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[32]  J. Gibson.  Observations on active touch. , 1962, Psychological review.

[33]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[34]  May,et al.  [Wiley Series in Probability and Statistics] Applied Survival Analysis (Regression Modeling of Time-to-Event Data) || Extensions of the Proportional Hazards Model , 2008 .

[35]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[36]  T. Sheridan.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[37]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[38]  Kevin P. Murphy.  Information theory , 1998 .

[39]  A. Raftery,et al.  Bayes factors , 1995 .