Vision for autonomous mobility: image processing on the VFE-200

The task of autonomous navigation comprises several subtasks, each of which has very specific requirements for the perception system. We analyze several of these subtasks from the perspective of computer vision, including: (i) obstacle detection, (ii) terrain reconstruction, (iii) convoying, (iv) collision detection, and (v) road recognition. We delineate the issues associated with each subtask and outline algorithms to address each issue. Finally, we address the issue of implementation. We present the VFE-200 as a very powerful image processing platform specifically designed for the implementation of autonomous mobility vision algorithms. We describe the architecture of the system, and how several key features make it ideally suited for hosting several government-sponsored autonomous mobility platforms such as MDARS-E, AUTONAV and Demo III.

[1]  Alonzo Kelly,et al.  Rough Terrain Autonomous Mobility—Part 1: A Theoretical Analysis of Requirements , 1998, Auton. Robots.

[2]  Ernst D. Dickmanns,et al.  Vehicles Capable of Dynamic Vision , 1997, IJCAI.

[3]  Lambert E. Wixson,et al.  Image alignment for precise camera fixation and aim , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[4]  Donald B. Gennery,et al.  Object Detection and Measurement Using Stereo Vision , 1979, IJCAI.

[5]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[7]  Hans P. Moravec.  Towards Automatic Visual Obstacle Avoidance , 1977, IJCAI.

[8]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Ernst D. Dickmanns,et al.  Vehicles Capable of Dynamic Vision: A New Breed of Technical Beings? , 1998, Artif. Intell..

[10]  G. Salgian,et al.  Electronically directed "focal" stereo , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Reinhold Behringer,et al.  Road recognition from multifocal vision , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[12]  K. Hanna.  Direct multi-resolution estimation of ego-motion and structure from motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[13]  Alonzo Kelly,et al.  Rough Terrain Autonomous Mobility—Part 2: An Active Vision, Predictive Control Approach , 1998, Auton. Robots.

[14]  Charles E. Thorpe,et al.  A specialized multibaseline stereo technique for obstacle detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[15]  Keith J. Hanna,et al.  Combining stereo and motion analysis for direct estimation of scene structure , 1993, 1993 (4th) International Conference on Computer Vision.

[16]  Hans P. Morevec.  Towards automatic visual obstacle avoidance , 1977, IJCAI 1977.