Selective Visual Perception Driven by Cues from Speech Processing

At the University of Bielefeld within the framework of the colloborative research center Situ ated Arti cial Communicators SFB an integrative system of vision and speech under standing is developed By the term arti cial communicators we mean formal systems which reconstruct the behaviour of natural communicators in relevant aspects Since most cognitive skills are situation dependent the SFB s research has concentrated on a speci c basis scenario The subject of this scenario is a task orientated discourse about construction acts The cooper ative assembly of a model aeroplane from construction kit parts see Figure is the long term goal

[1]  John F. Sowa,et al.  Conceptual Structures: Information Processing in Mind and Machine , 1983 .

[2]  Heinrich Niemann,et al.  ERNEST: A Semantic Network System for Pattern Understanding , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Christopher M. Brown,et al.  Issues in selective perception , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[4]  M. G. Wallace,et al.  Language as a cognitive process, vol I: Syntax, Terry Winograd, Addison‐Wesley, 1983. No. of pages: 640. ISBN 0 201 08571 2 , 1983 .

[5]  Heinrich Niemann,et al.  Control and explanation in a signal understanding environment , 1993, Signal Process..

[6]  Gérard G. Medioni,et al.  Part decomposition and description of 3D shapes , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[7]  Gerhard Sagerer,et al.  Integration von Bild- und Sprachverstehen in einer kognitiven Architektur , 1995 .

[8]  Werner von Seelen,et al.  Visual Information Processing in Neural Architecture , 1994 .

[9]  Heinrich Niemann,et al.  A Speech Understanding and Dialog System with a Homogeneous Linguistic Knowledge Base , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[11]  John F. Sowa,et al.  Principles of semantic networks , 1991 .

[12]  Gernot A. Fink,et al.  A communication framework for heterogeneous distributed pattern analysis , 1995, Proceedings 1st International Conference on Algorithms and Architectures for Parallel Processing.

[13]  Charles J. Fillmore,et al.  THE CASE FOR CASE. , 1967 .