Projective Relations for 3D Space: Computational Model, Application, and Psychological Evaluation

We propose a 3D computational model for projective relations which is used in an integrated image and speech understanding system. The image and speech understanding system is being developed within a joint research project focusing on both technical and cognitive aspects of human-computer interaction. Psychological experiments have been carried out to evaluate our computational model as an approximation of the meaning of projective prepositions used by humans in spoken instructions. These experiments investigate the acceptance of the model by subjects as well as the regularities regarding human usage of projective relations. Results of the computational model, the overall system, and the psychological experiments are presented.

[1]  Annette Herskovits,et al.  Language and spatial cognition , 1986 .

[2]  W. Wahister.  One word says more than a thousand pictures: on the automatic verbalization of the results of image sequence analysis system , 1987 .

[3]  Hans-Hellmut Nagel,et al.  From image sequences towards conceptual descriptions , 1988, Image Vis. Comput..

[4]  Wolfgang Wahlster,et al.  One word says more than a thousand pictures , 1989 .

[5]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[6]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[7]  David E. Irwin,et al.  Frames of reference in vision and language: Where is above? , 1993, Cognition.

[8]  John R. Kender,et al.  Qualitatively describing objects using spatial prepositions , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[9]  B. Landau,et al.  “What” and “where” in spatial language and spatial cognition , 1993 .

[10]  Klaus-Peter Gapp.  Basic Meanings of Spatial Relations: Computation and Evaluation in 3D Space , 1994, AAAI.

[11]  M. Tarr,et al.  Spatial language and spatial representation , 1995, Cognition.

[12]  Gerhard Sagerer,et al.  A three-dimensional spatial model for the interpretation of image data , 1998, IJCAI 1995.

[13]  Gudrun Socher,et al.  A Knowledge-based System Integrating Speech and Image Understanding – Manual Version 1 . 0 – , 1996 .

[14]  Franz Kummert,et al.  Talking about 3D scenes: integration of image and speech understanding in a hybrid distributed system , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.