Wall inspection control of a VTOL unmanned aerial vehicle based on a stereo optical flow

An autonomous wall inspection control based on a stereo optical flow, suitable for unmanned aerial vehicles endowed with a stereo vision system, is proposed in this paper. The inspection task consists of simultaneously controlling the inspection velocity along the surface, the relative yaw angle between the vehicle and the observed plane, as well as the orthogonal distance. A virtual spherical camera is considered at the center of gravity of the vehicle. Then, a stereo optical flow, as if it had been acquired by the virtual camera, is generated from the visual data provided by the stereo vision system. The 3D visual measurements are also employed to estimate the relative position and orientation of the observed plane. Hence, the absolute vehicle velocity is estimated by using a robust translational average optical flow by integrating the total stereo flow. Finally, an inspection control and a hovering control are proposed. The effectiveness of the described approach has been demonstrated with a dynamic simulation in an environment composed of two adjacent walls.

[1]  Nicolas H. Franceschini,et al.  Visually guided micro-aerial vehicle: automatic take off, terrain following, landing and wind reaction , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[2]  Robert E. Mahony,et al.  A terrain-following control approach for a VTOL Unmanned Aerial Vehicle using average optical flow , 2010, Auton. Robots.

[3]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[4]  Ling Zou,et al.  A method of stereo vision matching based on OpenCV , 2010, 2010 International Conference on Audio, Language and Image Processing.

[5]  Tarek Hamel,et al.  Attitude and gyro bias estimation for a flying UAV , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Tarek Hamel,et al.  Dynamic Image-Based Visual Servo Control Using Centroid and Optic Flow Features , 2008 .

[7]  J. Koenderink,et al.  Facts on optic flow , 1987, Biological Cybernetics.

[8]  Pascual Campoy Cervera,et al.  COLIBRI: A vision-Guided UAV for Surveillance and Visual Inspection , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  Peter I. Corke,et al.  Low-cost flight control system for a small autonomous helicopter , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[10]  R. Mahony,et al.  Robust trajectory tracking for a scale model autonomous helicopter , 2004 .

[11]  Jean-Arcady Meyer,et al.  A contribution to vision-based autonomous helicopter flight in urban environments , 2005, Robotics Auton. Syst..

[12]  D. Jones.  Power line inspection - a UAV concept , 2005 .

[13]  Michael P. Hayes,et al.  Biologically inspired UAV obstacle avoidance and control using monocular optical flow & divergence templates , 2011, The 5th International Conference on Automation, Robotics and Applications.

[14]  Robert E. Mahony,et al.  Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach , 2002, IEEE Trans. Robotics Autom..

[15]  Aníbal Ollero,et al.  A visual odometer without 3D reconstruction for aerial vehicles. Applications to building inspection , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[16]  Robert E. Mahony,et al.  Control of a quadrotor helicopter using visual feedback , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[17]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Hongke Xu,et al.  Keypoint matching in stereo vision , 2010, The 2nd International Conference on Information Science and Engineering.

[19]  Peter Corke.  An Inertial and Visual Sensing System for a Small Autonomous Helicopter , 2004, J. Field Robotics.

[20]  Robert E. Mahony,et al.  Landing a VTOL Unmanned Aerial Vehicle on a Moving Platform Using Optical Flow , 2012, IEEE Transactions on Robotics.

[21]  Vincenzo Lippiello,et al.  MAV indoor navigation based on a closed-form solution for absolute scale velocity estimation using Optical Flow and inertial data , 2011, IEEE Conference on Decision and Control and European Control Conference.

[22]  Dario Floreano,et al.  Fly-inspired visual steering of an ultralight indoor aircraft , 2006, IEEE Transactions on Robotics.

[23]  Jorge Dias,et al.  Vision and Inertial Sensor Cooperation Using Gravity as a Vertical Reference , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Jie Liu,et al.  I-BRIEF: A Fast Feature Point Descriptor with More Robust Features , 2011, 2011 Seventh International Conference on Signal Image Technology & Internet-Based Systems.

[25]  Svetha Venkatesh,et al.  Robot navigation inspired by principles of insect vision , 1999, Robotics Auton. Syst..

[26]  Nick Barnes,et al.  A Robust Docking Strategy for a Mobile Robot Using Flow Field Divergence , 2006, IEEE Transactions on Robotics.