Haptic synthesis of shapes and sequences.

Haptic perception of shape is based on kinesthetic and tactile information synthesized across space and time. We studied this process by having subjects move along the edges of multisided shapes and then remember and reproduce the shapes. With eyes closed, subjects moved a robot manipulandum whose force field was programmed to simulate a quadrilateral boundary in a horizontal plane. When subjects then reproduced the quadrilateral using the same manipulandum, with eyes still closed but now with the force field set to zero, they made consistent errors, overestimating the lengths of short segments and underestimating long ones, as well as overestimating acute angles and underestimating obtuse ones. Consequently their reproductions were more regular than the shapes they had experienced. When subjects felt the same quadrilaterals with the same manipulandum but drew them on a vertical screen with visual feedback, they made similar errors, indicating that their distortions reflected mainly perceptual rather than motor processes. In a third experiment, subjects explored the 3 sides of an open shape in a fixed order. The results revealed a temporal pattern of interactions, where the lengths and angles of previously explored segments influenced the drawing of later segments. In all tasks, our subjects were as accurate as subjects in earlier studies who haptically explored only single lines or angles, suggesting that the mental processes that synthesize haptic data from multiple segments into complete shapes do not introduce any net error.

[1]  R L Klatzky,et al.  Spatial and movement-based heuristics for encoding pattern information through touch. , 1985, Journal of experimental psychology. General.

[2]  F A Mussa-Ivaldi,et al.  Haptic interaction with virtual objects. Spatial perception and motor control. , 2000, Biological cybernetics.

[3]  S Appelle,et al.  Effect of Modality-Specific Experience on Visual and Haptic Judgment of Orientation , 1985, Perception.

[4]  S J Lederman,et al.  Exploring environments by hand or foot: time-based heuristics for encoding distance in movement space. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[5]  Frouke Hermens,et al.  Visual and Haptic Matching of Perceived Orientations of Lines , 2003, Perception.

[6]  Mary D Klein Breteler,et al.  Drawing sequences of segments in 3D: kinetic influences on arm configuration. , 2003, Journal of neurophysiology.

[7]  J. Deręgowski,et al.  Effect of stimulus orientation upon haptic perception of the horizontal-vertical illusion. , 1972, Journal of experimental psychology.

[8]  R H Day,et al.  Absence of the horizontal-vertical illusion in haptic space. , 1970, Journal of experimental psychology.

[9]  J. V. Van Gisbergen,et al.  Kinematic strategies for upper arm-forearm coordination in three dimensions. , 2000, Journal of neurophysiology.

[10]  S Lakatos,et al.  Haptic Underestimation of Angular Extent , 1998, Perception.

[11]  F A Mussa-Ivaldi,et al.  Haptic illusions: experiments on human manipulation and perception of "virtual objects". , 1990, Cold Spring Harbor symposia on quantitative biology.

[12]  J D Crawford,et al.  Curvature of Visual Space Under Vertical Eye Rotation: Implications for Spatial Vision and Visuomotor Control , 2000, The Journal of Neuroscience.

[13]  S. Cashdan,et al.  Visual and haptic form discrimination under conditions of successive stimulation. , 1968, Journal of experimental psychology.

[14]  J. F. Soechting,et al.  Bias and sensitivity in the haptic perception of geometry , 2003, Experimental Brain Research.

[15]  Stephan P. Swinnen,et al.  Proprioceptive control of multijoint movement: unimanual circle drawing , 1999, Experimental Brain Research.

[16]  P W Davidson,et al.  Proportion judgments in haptic and visual form perception. , 1980, Canadian journal of psychology.

[17]  Astrid M L Kappers,et al.  Haptic Perception of Spatial Relations , 1999, Perception.

[18]  Susan J. Lederman,et al.  Perception of interpolated position and orientation by vision and active touch , 1969 .

[19]  K. Lashley The problem of serial order in behavior , 1951 .

[21]  Roberta L Klatzky,et al.  Representing spatial location and layout from sparse kinesthetic contacts. , 2003, Journal of experimental psychology. Human perception and performance.

[22]  C M Taylor Visual and Haptic Perception of the Horizontal-Vertical Illusion , 2001, Perceptual and motor skills.

[23]  G P Bingham,et al.  Distortions in definite distance and shape perception as measured by reaching without and with haptic feedback. , 2000, Journal of experimental psychology. Human perception and performance.

[24]  R. Romo,et al.  Neuronal correlates of parametric working memory in the prefrontal cortex , 1999, Nature.

[25]  Roger Newport,et al.  Noninformative Vision Improves Haptic Spatial Perception , 2002, Current Biology.

[26]  Bruno B Averbeck,et al.  Parallel processing of serial movements in prefrontal cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[27]  L. Marks,et al.  Haptic perception of linear extent , 1999, Perception & psychophysics.

[28]  Stephan P. Swinnen,et al.  Proprioceptive control of multijoint movement: bimanual circle drawing , 1999, Experimental Brain Research.

[29]  J. F. Soechting,et al.  Sensorimotor representations for pointing to targets in three-dimensional space. , 1989, Journal of neurophysiology.

[30]  J. Soechting,et al.  Changes in spatial scale in drawing and handwriting: kinematic contributions by proximal and distal joints , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  J. F. Soechting,et al.  Coarticulation in Fluent Fingerspelling , 2003, The Journal of Neuroscience.

[32]  Apostolos P. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental Brain Research.

[33]  R L Klatzky,et al.  Path completion after haptic exploration without vision: Implications for haptic spatial representations , 1999, Perception & psychophysics.

[34]  Edouard Gentaz,et al.  The Reproduction of Vertical and Oblique Orientations in the Visual, Haptic, and Somatovestibular Systems , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.