Walking human avoidance and detection from a mobile robot using 3D depth flow

This paper shows walking human avoidance and detection behavior of a mobile robot using the 3D depth flow. The 3D depth flow proposed is able to measure the 3D motion vector of every pixels between two time sequential images. First, a definition of the 3D depth flow and a simple 3D depth flow calculation method are presented. Then an implementation of the real-time 3D depth flow generation system using a standard PC is described, and the experimental results are given. Finally, as an application, the walking human detection and avoidance task using a mobile robot in real environments is shown.

[1]  Yoshiaki Shirai,et al.  Optical flow-based person tracking by multiple cameras , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[2]  Takeo Kanade,et al.  A stereo machine for video-rate dense depth mapping and its new applications , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  R. Bolles,et al.  Spatiotemporal Consistency Checking of Passive Renge Data , 1993 .

[4]  Yoshiaki Shirai,et al.  Realtime multiple object tracking based on optical flows , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[5]  Masayuki Inaba,et al.  Real-time 3D flow generation system , 1999, Proceedings. 1999 IEEE/SICE/RSJ. International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI'99 (Cat. No.99TH8480).

[6]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[7]  Yasuo Kuniyoshi,et al.  Velocity and disparity cues for robust real-time binocular tracking , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Laurent Moll,et al.  Real time correlation-based stereo: algorithm, implementations and applications , 1993 .

[9]  Peter Corke,et al.  Frame-rate stereopsis using non-parametric transforms and programmable logic , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[10]  David Beymer,et al.  Real-Time Tracking of Multiple People Using Continuous Detection , 1999 .

[11]  Masayuki Inaba,et al.  Robot vision system with a correlation chip for real-time tracking, optical flow and depth map generation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[12]  Takeo Kanade,et al.  Three-dimensional scene flow , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Yoshifumi Kitamura,et al.  3-D path planning in a dynamic environment using an octree and an artificial potential field , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[14]  Masayuki Inaba,et al.  Development of a Humanoid H4 with Soft and Distributed Tactile Sensor Skin , 1999, ISER.