An MPEG-processor-based robot vision system for real-time detection of moving objects by a moving observer

Describes a PC-based vision system that can be used to detect moving objects from a mobile robot. An image processing board equipped with an MPEG motion estimation processor calculates a sparse but robust optic flow in real-time. An algorithm to evaluate this kind of optic flow has been realized in software. It determines relevant motion parameters and a simple scene interpretation in terms of moving object regions. The image processing board and the algorithm are presented in some detail; the performance of the system is demonstrated by experiments.

[1]  K. Prazdny,et al.  Determining The Instantaneous Direction Of Motion From Optical Flow Generated By A Curvilinearly Moving Observer , 1981, Other Conferences.

[2]  Yoshiaki Shirai,et al.  Realtime multiple object tracking based on optical flows , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[3]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  G. Farber,et al.  An image processing board with an MPEG processor and additional confidence calculation for fast and robust optic flow generation in real environments , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[5]  Masayuki Inaba,et al.  Real-time vision-based control of swing motion by a human-form robot using the remote-brained approach , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[6]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Darius Burschka,et al.  Vision based model generation for indoor environments , 1997, Proceedings of International Conference on Robotics and Automation.

[8]  Masayuki Inaba,et al.  Robot vision system with a correlation chip for real-time tracking, optical flow and depth map generation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[9]  K. Prazdny.  Determining The Instantaneous Direction Of Motion From Optical Flow Generated By A Curvilinearly Moving Observer , 1981, Other Conferences.

[10]  Gordon Cheng,et al.  Real-time visual behaviours for navigating a mobile robot , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.