Reactive avoidance of dynamic obstacles through optimization of their epipoles

This paper proposes a new reactive method of avoiding dynamic obstacles by real-time optimization. A mobile robot is equipped with a monocular camera and dynamic obstacles are identified in the image sequence by clustering the optical flow. The respective epipoles of the clusters are determined and afterwards the relative epipole positions are evaluated to identify colliding and dangerous objects. In this work the correlation between the vehicle's velocities and the cluster epipoles is derived and utilized in the proposed cost function for shifting the epipoles. By optimizing this cost function the vehicle is able to avoid collisions, which means that the 3D motion is deduced from purely 2D image data. Finally, the validity of the concept is confirmed by hardware-in-the-loop simulations.

[1]  Alexander Schaub,et al.  Simulation of Artificial Intelligence Agents using Modelica and the DLR Visualization Library , 2012 .

[2]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[3]  Horst Bischof,et al.  A Duality Based Approach for Realtime TV-L1 Optical Flow , 2007, DAGM-Symposium.

[4]  Martin Herman,et al.  Real-time obstacle avoidance using central flow divergence and peripheral flow , 2017, Proceedings of IEEE International Conference on Computer Vision.

[5]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[6]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[7]  Stefano Ghidoni,et al.  TerraMax Vision at the Urban Challenge 2007 , 2010, IEEE Transactions on Intelligent Transportation Systems.

[8]  Camillo J. Taylor,et al.  Expansion segmentation for visual collision detection and estimation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Amaury Nègre,et al.  A comparison of three methods for measure of Time to Contact , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[11]  Sergiu Nedevschi,et al.  Real-time obstacle detection using dense stereo vision and dense optical flow , 2010, Proceedings of the 2010 IEEE 6th International Conference on Intelligent Computer Communication and Processing.

[12]  Johann Bals,et al.  ROMO - THE ROBOTIC ELECTRIC VEHICLE , 2011 .

[13]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[14]  Darius Burschka,et al.  Spatio-temporal prediction of collision candidates for static and dynamic objects in monocular image sequences , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[15]  Giulio Sandini,et al.  Robotic bees , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[16]  M. Tistarelli,et al.  Direct estimation of time-to-impact from optical flow , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[17]  Darius Burschka,et al.  Z˜(inf) - Monocular Localization Algorithm with Uncertainty Analysis for Outdoor Applications , 2010 .

[18]  Darius Burschka,et al.  Mobile Robots Navigation , 2010 .