Local histogram matching for efficient optical flow computation applied to velocity estimation on pocket drones

Autonomous flight of pocket drones is challenging due to the severe limitations on on-board energy, sensing, and processing power. However, tiny drones have great potential as their small size allows maneuvering through narrow spaces while their small weight provides significant safety advantages. This paper presents a computationally efficient algorithm for determining optical flow, which can be run on an STM32F4 microprocessor (168 MHz) of a 4 gram stereo-camera. The optical flow algorithm is based on edge histograms. We propose a matching scheme to determine local optical flow. Moreover, the method allows for sub-pixel flow determination based on time horizon adaptation. We demonstrate velocity measurements in flight and use it within a velocity control-loop on a pocket drone.

[1]  Rogelio Lozano,et al.  Real-Time Stabilization of an Eight-Rotor UAV Using Optical Flow , 2009, IEEE Transactions on Robotics.

[2]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[3]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Randal W. Beard,et al.  See and avoidance behaviors for autonomous navigation , 2004, SPIE Optics East.

[5]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[6]  Dario Floreano,et al.  Optic-Flow Based Control of a 46g Quadrotor , 2013 .

[7]  Heinrich H. Bülthoff,et al.  Nonlinear ego-motion estimation from optical flow for online control of a quadrotor UAV , 2015, Int. J. Robotics Res..

[8]  G. C. H. E. de Croon,et al.  Lisa-S 2.8g autopilot for GPS-based flight of MAVs , 2014 .

[9]  Karthik Dantu,et al.  Autonomous MAV guidance with a lightweight omnidirectional vision sensor , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Daniel Cremers,et al.  Visual-Inertial Navigation for a Camera-Equipped 25g Nano-Quadrotor , 2014 .

[12]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[13]  Mandyam V Srinivasan,et al.  Honeybees as a model for the study of visually guided flight, navigation, and biologically inspired robotics. , 2011, Physiological reviews.

[14]  Nicolas Petit,et al.  The Navigation and Control technology inside the AR.Drone micro UAV , 2011 .

[15]  Guido C. H. E. de Croon,et al.  Autonomous flight of a 20-gram Flapping Wing MAV with a 4-gram onboard stereo vision system , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).