Neural processing of biological motion in the macaque temporal cortex

Cells have been found in the superior temporal polysensory area (STPa) of the macaque temporal cortex which are selectively responsive to the sight of particular whole body movements (e.g., walking) under normal lighting. These cells typically discriminate the direction of walking and the view of the body (e.g., left profile walking left). We investigated the extent to which these cells are responsive under `biological motion' conditions where the form of the body is defined only by the movement of light patches attached to the points of limb articulation. One third of the cells (25/72) selective for the form and motion of waling bodies, showed sensitivity to the moving light displays. Seven of these cells showed only partial sensitivity to form from motion, in so far as the cells responded more to moving light displays than to moving controls but failed to discriminate body view. These seven cells exhibited directional selectivity. Eighteen cells showed statistical discrimination for both direction of movement and body view under biological motion conditions. Most of these cells showed reduced responses to the impoverished moving light stimuli compared to full light conditions. The 18 cells were thus sensitive to detailed form information (body view) from the pattern of articulating motion. Cellular processing of the global pattern of articulation was indicated by the observations that none of the cells were found sensitive to movement of individual limbs and that jumbling the pattern of moving limbs reduced response magnitude. The cell responses thus provide direct evidence for neural mechanisms computing form from non-rigid motion. The selectivity of the cells was for body view, specific direction and specific type of body motion presented by moving light displays and is not predicted by many current computational approaches to the extraction of form from motion.

[1]  G. Mather,et al.  Low-level visual processing of biological motion , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[2]  A. J. Mistlin,et al.  Visual cells in the temporal cortex sensitive to face view and gaze direction , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  K. Nakayama,et al.  Intact “biological motion” and “structure from motion” perception in a patient with impaired motion mechanisms: A case study , 1990, Visual Neuroscience.

[4]  A. J. Mistlin,et al.  Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. , 1984, Human neurobiology.

[5]  Keiji Tanaka,et al.  Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. , 1988, Journal of neurophysiology.

[6]  J. Cutting Generation of Synthetic Male and Female Walkers through Manipulation of a Biomechanical Invariant , 1978, Perception.

[7]  J E Cutting,et al.  A biomechanical invariant for gait perception. , 1978, Journal of experimental psychology. Human perception and performance.

[8]  Glyn W. Humphreys,et al.  Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence , 1993, Neuropsychologia.

[9]  R. Desimone,et al.  Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[10]  C. Koch,et al.  The analysis of visual motion: from computational theory to neuronal mechanisms. , 1986, Annual review of neuroscience.

[11]  R. M. Siegel,et al.  The Perception of Structure from Visual Motion in Monkey and Man , 1990, Journal of Cognitive Neuroscience.

[12]  J S Lappin,et al.  Minimal conditions for the visual detection of structure and motion in three dimensions. , 1980, Science.

[13]  W. Dittrich Action Categories and the Perception of Biological Motion , 1993, Perception.

[14]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[15]  B. Bertenthal,et al.  The role of occlusion in reducing multistability in moving point-light displays , 1984, Perception & psychophysics.

[16]  J E Cutting,et al.  Masking the motions of human gait , 1988, Perception & psychophysics.

[17]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[18]  D R Proffitt,et al.  The development of infant sensitivity to biomechanical motions. , 1985, Child development.

[19]  D I Perrett,et al.  Frameworks of analysis for the neural representation of animate objects and actions. , 1989, The Journal of experimental biology.

[20]  Hsi-Jian Lee,et al.  Determination of 3D human body postures from a single view , 1985, Comput. Vis. Graph. Image Process..

[21]  Yee-Hong Yang,et al.  A region based approach for human body motion analysis , 1987, Pattern Recognit..