Real-time vision system for robots in unstructured domains

We are interested in visual capabilities that enable robots to act in dynamic, unstructured domains. Towards this end, we have designed a vision system that has the capability of segmenting and tracking a moving object. Our system has been implemented and runs in real- time on a Connection Machine. We have configured a HERO-2000 robot to use the vision system for control. Based on object centroids provided by the vision system, the robot pans to follow a large moving object in the field of view. The robot has proven capable of reliably tracking a moving person for several minutes. In this paper, we present the visual capabilities we have constructed and justify their utility for unstructured environments. We then describe our algorithms, their implementation, and their use in the panning robot.

[1]  Rodney A. Brooks,et al.  Building Robots: Expectations and Experiences , 1989, Proceedings. IEEE/RSJ International Workshop on Intelligent Robots and Systems '. (IROS '89) 'The Autonomous Mobile Robots and Its Applications.

[2]  Anselm Spoerri,et al.  The early detection of motion boundaries , 1990, ICCV 1987.

[3]  Jake K. Aggarwal,et al.  Structure from Motion of Rigid and Jointed Objects , 1981, Artif. Intell..

[4]  Ramin Zabih,et al.  An Algorithm for Real-Time Tracking of Non-Rigid Objects , 1991, AAAI.

[5]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[6]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[7]  Charles R. Dyer,et al.  Real-time, parallel motion tracking of three dimensional objects from spatiotemporal sequences , 1990 .