Integrating Vision Based Behaviours with an Autonomous Robot

Although many different vision algorithms and systems have been developed so far, integration into a complex intelligent control architecture of a mobile robot is in most cases an open problem. In this paper we describe the integration of different vision based behaviours into our architecture for sensorimotor systems. By means of different scenarios like person tracking and searching of different objects, the structure of the vision system and the interaction with the overall architecture is explained. Especially the interaction of vision based modules with the task level control and the symbolic world model is an important topic. The architecture is successfully used on different mobile robots in natural indoor environments.

[1]  Daniel P. Huttenlocher,et al.  Tracking non-rigid objects in complex scenes , 1993, 1993 (4th) International Conference on Computer Vision.

[2]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Other Conferences.

[3]  Tim Ellis,et al.  Tracking using colour information , 1994 .

[4]  Erann Gat,et al.  Experiences with an architecture for intelligent, reactive agents , 1997, J. Exp. Theor. Artif. Intell..

[5]  Osama Masoud,et al.  Pedestrian tracking from a stationary camera using active deformable models , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[6]  Jake K. Aggarwal,et al.  Tracking human motion in an indoor environment , 1995, Proceedings., International Conference on Image Processing.

[7]  Erann Gat,et al.  ESL: a language for supporting robust plan execution in embedded autonomous agents , 1997, 1997 IEEE Aerospace Conference.

[8]  Christian Schlegel,et al.  The software framework SMARTSOFT for implementing sensorimotor systems , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[9]  David Kortenkamp,et al.  A mobile robot that recognizes people , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[10]  J. Canny.  Finding Edges and Lines in Images , 1983 .

[11]  J.-S. Gutmann,et al.  AMOS: comparison of scan matching approaches for self-localization in indoor environments , 1996, Proceedings of the First Euromicro Workshop on Advanced Mobile Robots (EUROBOT '96).

[12]  Bernhard Nebel,et al.  Extending Planning Graphs to an ADL Subset , 1997, ECP.

[13]  Robert James Firby,et al.  Adaptive execution in complex dynamic worlds , 1989 .

[14]  Christian Schlegel.  Fast local obstacle avoidance under kinematic and dynamic constraints for a mobile robot , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[15]  Christian Schlegel,et al.  Vision Based Person Tracking with a Mobile Robot , 1998, BMVC.

[16]  Robin R. Murphy,et al.  Artificial intelligence and mobile robots: case studies of successful robot systems , 1998 .

[17]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[18]  Franz J. Radermacher,et al.  COGNITION IN SYSTEMS , 1996 .

[19]  Nikolaos Papanikolopoulos,et al.  DETECTION AND TRACKING OF TRAFFIC OBJECTS IN IVHS VISION SENSING MODALITIES , 1995 .

[20]  Fabrice R. Noreils.  Integrating error recovery in a mobile robot control system , 1990, Proceedings., IEEE International Conference on Robotics and Automation.