Representational Levels for the Perception of the Courses of Motion

The problem of representation and processing of motion information is addressed from an integrated perspective covering the range from early visual processing to higher-level cognitive aspects. A spatio-temporal memory is presented as indispensible representational prerequisite for the recognition of spatiotemporal gestalt. We assume that this structure is replicated on different processing-levels in the visual system mirroring its hierarchical structure. Thus, each level requires a different representation for spatio-temporal information. As a first step, we present a two-layered architecture for the qualitative representation of motion trajectories: The vectorial layer is quite accurate and allows switches between deictic and intrinsic frame of reference. The propositional layer is more abstract and reveals similarities and regularities of motion paths which will be useful for motion prediction. First psychophysical experiments indicate that information about direction and position are not stored independently but mereley in form of a spatio-temporal compound.

[1]  D. Rosenbaum.  Perception and extrapolation of velocity and acceleration. , 1975, Journal of experimental psychology. Human perception and performance.

[2]  R N Shepard,et al.  Path-guided apparent motion. , 1983, Science.

[3]  R. Sekuler,et al.  Psychophysics of Motion Perception , 1982 .

[4]  U. Bellugi,et al.  Perception of American sign language in dynamic point-light displays. , 1981, Journal of experimental psychology. Human perception and performance.

[5]  Alberto Del Bimbo,et al.  Sequence retrieval by contents through spatio temporal indexing , 1993, Proceedings 1993 IEEE Symposium on Visual Languages.

[6]  P. Werkhoven,et al.  Visual processing of optic acceleration , 1992, Vision Research.

[7]  Wilfried Brauer,et al.  Visual representation of spatio-temporal structure , 1998 .

[8]  Boi Faltings,et al.  Qualitative Kinematics: A Framework , 1987, IJCAI.

[9]  Jonathan H. Fernyhough.  Qualitative Reasoning for Automated Traffic Surveillance , 1996 .

[10]  P. Johnson-Laird.  Mental models , 1989 .

[11]  Karl Rohr,et al.  Integrating Vision and Language: Towards Automatic Description of Human Movements , 1995, KI.

[12]  I. Rock,et al.  An introduction to perception , 1975 .

[13]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[14]  J. Cutting,et al.  The minimum principle and the perception of absolute, common, and relative motions , 1982, Cognitive Psychology.

[15]  Boi Faltings,et al.  Qualitative Kinematics in Mechanisms , 1987, IJCAI.

[16]  Christoph Zetzsche,et al.  A model of visual spatio-temporal memory: The icon revisited , 1995, Psychological research.

[17]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[18]  B. Julesz.  Binocular depth perception of computer-generated patterns , 1960 .

[19]  Kenneth D. Forbus.  Qualitative Reasoning About Space and Motion , 1983 .

[20]  Alberto Del Bimbo,et al.  Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic , 1995, IEEE Trans. Knowl. Data Eng..

[21]  Jonathan H. Fernyhough.  Event Recognition using Qualitative Reasoning on Automatically Generated Spatio-Temporal Models from , 1997 .

[22]  Antony Galton,et al.  Space, Time, and Movement , 1997 .

[23]  Julian Hochberg,et al.  Representation of motion and space in video and cinematic displays , 1986 .

[24]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[25]  O. Braddick.  A short-range process in apparent motion. , 1974, Vision research.

[26]  W. Reichardt.  Autokorrelations-Auswertung als Funktionsprinzip des Zentralnervensystems , 1957 .

[27]  Erland Jungert.  Symbolic Spatial Reasoning on Object Shapes for Qualitative Matching , 1993, COSIT.

[28]  Michael Mohnhaupt.  Eine hybride Repräsentation von Objektbewegungen: Von analogen zu propositionalen Beschreibungen , 1990, Repräsentation und Verarbeitung räumlichen Wissens.

[29]  J. Freyd.  Dynamic mental representations. , 1987, Psychological review.

[30]  B Brown,et al.  Predicting the Future Position of a Moving Target , 1991, Perception.

[31]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[32]  Boi Faltings,et al.  Recent advances in qualitative physics , 1993 .

[33]  Andrew T. Smith,et al.  Visual detection of motion , 1994 .

[34]  Johan de Kleer,et al.  Readings in qualitative reasoning about physical systems , 1990 .

[35]  R. Finke,et al.  Mental extrapolation and representational momentum for complex implied motions. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[36]  J. J. Koenderink,et al.  Temporal properties of the visual detectability of moving spatial white noise , 2004, Experimental Brain Research.

[37]  Ernst Piippel.  A hierarchical model of temporal perception , 1997 .

[38]  G Johansson,et al.  Spatio-temporal differentiation and integration in visual motion perception , 1976, Psychological research.

[39]  J. Freyd,et al.  Probing the time course of representational momentum. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[40]  Alberto Del Bimbo,et al.  A spatio-temporal logic for image sequence coding and retrieval , 1992, Proceedings IEEE Workshop on Visual Languages.

[41]  G. Johansson.  Visual motion perception. , 1975, Scientific American.

[42]  R A Finke,et al.  Implied velocity and acceleration induce transformations of visual memory. , 1986, Journal of experimental psychology. General.

[43]  D. Rosenbaum.  Perception and extrapolation of velocity and acceleration. , 1975 .

[44]  Wilfried Brauer,et al.  Visual representation of spatiotemporal structure , 1998, Electronic Imaging.

[45]  G. Sperling,et al.  The functional architecture of human visual motion perception , 1995, Vision Research.

[46]  Ernst Pöppel,et al.  Time perception: problems of representation and processing , 1998 .

[47]  Géry d'Ydewalle,et al.  Representational momentum and event course anticipation in the perception of implied periodical motions. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[48]  Chuan Yi Tang,et al.  A 2.|E|-Bit Distributed Algorithm for the Directed Euler Trail Problem , 1993, Inf. Process. Lett..

[49]  Hyun kyung Lee Kim.  Qualitative kinematics of linkages , 1993 .