A filtering approach for computation of real-time dense optical-flow for robotic applications

The present article presents an iterative filter approach for the computation of optical-flow. The filter is based on an update and propagation loop. The propagation stage takes the currently computed flow to predict the value at the next time iteration. The update stage takes this prediction, together with the stream of images, and corrects the optical-flow field. This leads to an incremental approach to build optical-flow. Regions of the image where no flow computation is possible are filled in by a diffusion term in the propagation step. Ground truth validation of the algorithm is provided by simulating a high-speed camera in a 3D scene. The local computations and convolution based implementation is well suited for real-time systems with high-speed and high-acuity cameras.

[1]  Nick Barnes,et al.  Performance of optical flow techniques for indoor navigation with a mobile robot , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[2]  Michael J. Black.  Robust incremental optical flow , 1992 .

[3]  Nicolas H. Franceschini,et al.  Bio-inspired optic flow sensors based on FPGA: Application to Micro-Air-Vehicles , 2007, Microprocess. Microsystems.

[4]  Mandyam V. Srinivasan,et al.  An image-interpolation technique for the computation of optic flow and egomotion , 1994, Biological Cybernetics.

[5]  Mandyam V. Srinivasan,et al.  Landing Strategies in Honeybees and Applications to Uninhabited Airborne Vehicles , 2004, Int. J. Robotics Res..

[6]  Michael J. Black,et al.  A Naturalistic Open Source Movie for Optical Flow Evaluation , 2012, ECCV.

[7]  M. Srinivasan,et al.  Visual motor computations in insects. , 2004, Annual review of neuroscience.

[8]  Marc Pollefeys,et al.  An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  H. Kalmus.  Biological Cybernetics , 1972, Nature.

[10]  Martin Herman,et al.  Real-time obstacle avoidance using central flow divergence and peripheral flow , 2017, Proceedings of IEEE International Conference on Computer Vision.

[11]  J. W. Thomas.  Numerical Partial Differential Equations: Finite Difference Methods , 1995 .

[12]  George A. Bekey,et al.  On autonomous robots , 1998, The Knowledge Engineering Review.

[13]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[15]  Javier Díaz,et al.  FPGA-based real-time optical-flow system , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Mandyam V. Srinivasan,et al.  An Optical System for Guidance of Terrain Following in UAVs , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[17]  Nicolas H. Franceschini,et al.  Optic flow regulation: the key to aircraft automatic guidance , 2005, Robotics Auton. Syst..