Autonomous quadrotor flight with vision-based obstacle avoidance in virtual environment

In this paper, vision-based autonomous flight with a quadrotor type unmanned aerial vehicle (UAV) is presented. Automatic detection of obstacles and junctions are achieved by the use of optical flow velocities. Variation in the optical flow is used to determine the reference yaw angle. Path to be followed is generated autonomously and the path following process is achieved via a PID controller operating as the low level control scheme. Proposed method is tested in the Google Earth(R) virtual environment for four different destination points. In each case, autonomous UAV flight is successfully simulated without observing collisions. The results show that the proposed method is a powerful candidate for vision based navigation in an urban environment. Claims are justified with a set of experiments and it is concluded that proper thresholding of the variance of the gradient of optical flow difference have a critical effect on the detectability of roads having different widths.

[1]  Q. Henry Wu,et al.  Motion Detection Based On Accumulative Optical Flow and Double Background Filtering , 2007, World Congress on Engineering.

[2]  Samir Bouabdallah,et al.  Design and control of quadrotors with application to autonomous flying , 2007 .

[3]  M.Y. Amir,et al.  Modeling of Quadrotor Helicopter Dynamics , 2008, 2008 International Conference on Smart Manufacturing Application.

[4]  Okyay Kaynak,et al.  Adaptive neuro-fuzzy inference system based autonomous flight control of unmanned air vehicles , 2007, Expert Syst. Appl..

[5]  Rogelio Lozano,et al.  Modelling and Control of Mini-Flying Machines , 2005 .

[6]  Ted Camus Real-Time Quantized Optical Flow , 1997, Real Time Imaging.

[7]  Reinhard Klette,et al.  Moving Object Segmentation Using Optical Flow and Depth Information , 2009, PSIVT.

[8]  C. Laugier,et al.  Real-time moving obstacle detection using optical flow models , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[9]  M. Srinivasan,et al.  Visual regulation of ground speed and headwind compensation in freely flying honey bees (Apis mellifera L.) , 2006, Journal of Experimental Biology.

[10]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[11]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[12]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[13]  Pattie Maes,et al.  Maze Navigation Using Optical Flow , 1996 .

[14]  Brett R. Fajen,et al.  Visual navigation and obstacle avoidance using a steering potential function , 2006, Robotics Auton. Syst..

[15]  B. D. Lucas Generalized image matching by the method of differences , 1985 .

[16]  Karl Johan Åström,et al.  PID Controllers: Theory, Design, and Tuning , 1995 .

[17]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[18]  Zhang,et al.  Honeybee navigation en route to the goal: visual flight control and odometry , 1996, The Journal of experimental biology.

[19]  Shengping Zhang,et al.  Dynamic Background Subtraction Based on Local Dependency Histogram , 2008, Int. J. Pattern Recognit. Artif. Intell..

[20]  Ben J. A. Kröse,et al.  Navigation of a mobile robot on the temporal development of the optic flow , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[21]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[22]  M. Egelhaaf,et al.  Vision in flying insects , 2002, Current Opinion in Neurobiology.

[23]  Tiziana D'Orazio,et al.  An energy-based background modelling algorithm for motion detection , 2006, ICINCO-RA.

[24]  Yun Li,et al.  PID control system analysis, design, and technology , 2005, IEEE Transactions on Control Systems Technology.

[25]  S. Heinrich Fast obstacle detection using flow/depth constraint , 2002, Intelligent Vehicle Symposium, 2002. IEEE.