A method for the real-time rendering of formless dot field structure-from-motion stimuli.

The perception of visual motion relies on different computations and different neural substrates than the perception of static form. It is therefore useful to have psychophysical stimuli that carry mostly or entirely motion information, conveying little or nothing about form in any single frame. Structure-from-motion stimuli can sometimes achieve this dissociation, with some examples in studies of biological motion using point-light walkers. It is, however, generally not trivial to provide motion information without also providing static form information. The problem becomes more computationally difficult when the structures and the motions in question are complex. Here we present a technique by which an animated three-dimensional scene can be rendered in real-time as a pattern of dots. Each dot follows the trajectory of the underlying object in the animation, but each static frame of the animation appears to be a uniform random field of dots. The resulting stimuli capture motion vectors across arbitrary complex scenes, while providing virtually no instantaneous information about the structure of that scene. We also present the results of a psychophysical experiment demonstrating the efficacy and the limitations of the technique. The ability to create such stimuli on the fly allows for interactive adjustment and control of the stimuli, real-time parametric variations of structure and motion, and the creation of large libraries of actions without the need to pre-render a prohibitive number of movies. This technique provides a powerful tool for the dissociation of complex motion from static form.

[1]  Antonino Casile,et al.  Critical features for the recognition of biological motion. , 2005, Journal of vision.

[2]  Peter Ulric Tse,et al.  The duration of 3-D form analysis in transformational apparent motion , 2002, Perception & psychophysics.

[3]  Roberto Cipolla,et al.  Structure from motion , 2008 .

[4]  J A Beintema,et al.  Perception of biological motion without local image motion , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[5]  K. Nakayama,et al.  Intact “biological motion” and “structure from motion” perception in a patient with impaired motion mechanisms: A case study , 1990, Visual Neuroscience.

[6]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[7]  D. D. Hoffman,et al.  The interpretation of biological motion , 1982, Biological Cybernetics.

[8]  G Sperling,et al.  Kinetic depth effect and identification of shape. , 1989, Journal of experimental psychology. Human perception and performance.

[9]  P. Tse,et al.  Rotating dotted ellipses: Motion perception driven by grouped figural rather than local dot motion signals , 2007, Vision Research.

[10]  Stefan Treue,et al.  Human perception of structure from motion , 1991, Vision Research.

[11]  J S Lappin,et al.  Detection of three-dimensional structure in moving optical patterns. , 1984, Journal of experimental psychology. Human perception and performance.

[12]  W. J. V. Damme,et al.  Non-visual Information in Structure-from-motion , 1996, Vision Research.

[13]  A. Cowey,et al.  Blindness to form from motion despite intact static form perception and motion detection , 2000, Neuropsychologia.

[14]  C Caudek,et al.  Perceiving surface slant from deformation of optic flow. , 1999, Journal of experimental psychology. Human perception and performance.

[15]  H. Wallach,et al.  The kinetic depth effect. , 1953, Journal of experimental psychology.

[16]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .