A recognition network model-based approach to dynamic image understanding

In this paper, we present definitions for a dynamic knowledge-based image understanding system. From a sequence of grey level images, the system produces a flow of image interpretations. We use a semantic network to represent the knowledge embodied in the system. Dynamic representation is achieved by ahypotheses network. This network is a graph in which nodes represent information and arcs relations. A control strategy performs a continuous update of this network. The originality of our work lies in the control strategy: it includes astructure tracking phase, using the representation structure obtained from previous images to reduce the computational complexity of understanding processes. We demonstrate that in our case the computational complexity, which is exponential if we only use a purely data-driven bottom-up scheme, is polynomial when using the hypotheses tracking mechanism. This is to say that gain improvement in computation time is a major reason for dynamic understanding. The proposed system is implemented; experimental results of road mark detection and tracking are given.

[1]  Ruud M. Bolle,et al.  A Complete and Extendable Approach to Visual Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Thomas O. Binford,et al.  Survey of Model-Based Image Analysis Systems , 1982 .

[3]  John K. Tsotsos Representational axes and temporal cooperative processes , 1987 .

[4]  W. Eric L. Grimson The Combinatorics of Heuristic Search Termination for Object Recognition in Cluttered Environments , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  R. Nevatia,et al.  Perceptual Organization for Scene Segmentation and Description , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Robert C. Bolles,et al.  Representation space: an approach to the integration of visual information , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  R. Behringer,et al.  Road and relative ego-state recognition , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[8]  Patrick Rives,et al.  HIGH-SPEED VEHICLE GUIDANCE BASED ON VISION , 1993 .

[9]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[10]  Radu Horaud,et al.  Finding Geometric and Relational Structures in an Image , 1990, ECCV.

[11]  Makoto Nagao,et al.  A Structural Analysis of Complex Aerial Photographs , 1980, Advanced Applications in Pattern Recognition.

[12]  Daniel Sabbah Computing with connections in visual recognition of origami objects , 1985 .

[13]  Ramakant Nevatia,et al.  Segmentation and description based on perceptual organization , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Y. Ohta Knowledge-based interpretation of outdoor natural color scenes , 1998 .

[15]  H. Penny Nii,et al.  The Handbook of Artificial Intelligence , 1982 .

[16]  ZhangJun,et al.  A Markov Random Field Model-Based Approach to Image Interpretation , 1992 .

[17]  Thomas M. Strat,et al.  Context-Based Vision: Recognizing Objects Using Information from Both 2D and 3D Imagery , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  James W. Modestino,et al.  A Markov Random Field Model-Based Approach To Image Interpretation , 1989, Other Conferences.

[19]  John K. Tsotsos On the relative complexity of active vs. passive visual search , 2004, International Journal of Computer Vision.

[20]  Bruce A. Draper,et al.  The schema system , 1988, International Journal of Computer Vision.

[21]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..