Techniques for the production of point-light and fully illuminated video displays from identical recordings

Illumination of only a few key points on a moving human body or face is enough to convey a compelling perception of human motion. A full understanding of the perception ofbiological motion from point-light displays requires accurate comparison with the perception of motion in normal, fully illuminated versions of the same images. Traditionally, these two types of stimuli (point-light and fully illuminated) have been filmed separately, allowing the introduction of uncontrolled variation across recordings. This is undesirable for accurate comparison of perceptual performance across the two types of display. This article describes simple techniques, using proprietary software, that allow production of point-light and fully illuminated video displays from identical recordings. These techniques are potentially useful for many studies of motion perception, by permitting precise comparison of perceptual performances across point-light displays and their fully illuminated counterparts with accuracy and comparative ease.

[1]  R. Blake,et al.  Perception of Biological Motion , 1997, Perception.

[2]  Timothy R. Jordan,et al.  Effects of Distance on Visual and Audiovisual Speech Recognition , 2000 .

[3]  T. R. Jordan,et al.  Seeing and hearing rotated faces: influences of facial orientation on visual and audiovisual speech recognition. , 1997, Journal of experimental psychology. Human perception and performance.

[4]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[5]  J. N. Bassili Facial motion in the perception of faces and of emotional expression. , 1978, Journal of experimental psychology. Human perception and performance.

[6]  Pawan Sinha,et al.  Top-down influences on stereoscopic depth-perception , 1998, Nature Neuroscience.

[7]  Sharon M. Thomas,et al.  Effects of horizontal viewing angle on visual and audiovisual speech recognition. , 2001, Journal of experimental psychology. Human perception and performance.

[8]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[9]  D. Berry What can a moving face tell us? , 1990, Journal of personality and social psychology.

[10]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[11]  Maggie Shiffrar,et al.  The perception of biological motion across apertures , 1997, Perception & psychophysics.

[12]  N. P. Erber Interaction of audition and vision in the recognition of oral speech stimuli. , 1969, Journal of speech and hearing research.

[13]  Q Summerfield,et al.  Use of Visual Information for Phonetic Perception , 1979, Phonetica.

[14]  Norimasa Yamada,et al.  Nature of variability in rhythmical movement , 1995 .

[15]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[16]  The contribution of a reduced visual image to speech perception in noise , 1994 .

[17]  J. A. Johnson,et al.  Point-light facial displays enhance comprehension of speech in noise. , 1996, Journal of speech and hearing research.

[18]  J. Cutting,et al.  Recognizing friends by their walk: Gait perception without familiarity cues , 1977 .

[19]  G. Mather,et al.  Gender discrimination in biological motion displays based on dynamic cues , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[20]  David C. Burr,et al.  Seeing biological motion , 1998, Nature.

[21]  L. Rosenblum,et al.  An audiovisual test of kinematic primitives for visual speech perception. , 1996, Journal of experimental psychology. Human perception and performance.

[22]  Geoffrey P. Bingham Kinematic Form and Scaling: Further Investigations on the Visual Perception of Lifted Weight , 1987 .

[23]  Dominic W. Massaro,et al.  Perception of Synthetic Visual Speech , 1996 .

[24]  S. Runeson,et al.  Visual perception of lifted weight. , 1981, Journal of experimental psychology. Human perception and performance.

[25]  S. Lea,et al.  Perception of Emotion from Dynamic Point-Light Displays Represented in Dance , 1996, Perception.

[26]  S. Stevenage,et al.  Visual analysis of gait as a cue to identity , 1999 .

[27]  Timothy R. Jordan,et al.  Visual and audiovisual speech perception with color and gray-scale facial images , 2000, Perception & psychophysics.