Visual attitude stabilization of a unmanned helicopter in unknown environments with an embedded single-board computer

Enabling a flying robot to navigate autonomously in an unstructured and unknown indoor or outdoor environment is a big challenge. Attitude is one of the most important parameters for an autonomous UAV during such a flight. In this paper, we present the use of a vision system that can be used to estimate vehicle attitude using monocular pinhole camera only. Vision system are readily available on various UAV platforms and can be used for this purpose. Unlike previous work, this approach does not require (natural or artificial) parallel lines, ground markers or landmarks on the environment as clues, or use external sensors (e.g. VICON or GPS), additional on-board sensors (e.g. IMU), or additional special purpose cameras or multiple sensors. The proposed algorithm relies on on-board vision only, and the vision processing and control are performed on-board the vehicle using a single-board vision computer. After explanation of the algorithm, detailed presentation of the developed system and experimental set-up are provided. Finally, the results of the estimation and control experiments performed on a model quadrotor helicopter are presented.

[1]  Pascal Vasseur,et al.  UAV Attitude estimation by vanishing points in catadioptric images , 2008, 2008 IEEE International Conference on Robotics and Automation.

[2]  Patrick Doherty,et al.  Vision-based pose estimation for autonomous indoor navigation of micro-scale Unmanned Aircraft Systems , 2010, 2010 IEEE International Conference on Robotics and Automation.

[3]  Reinhard German,et al.  An Indoor Localization Framework for Four-Rotor Flying Robots Using Low-Power Sensor Nodes , 2011, IEEE Transactions on Instrumentation and Measurement.

[4]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[5]  G. Gerhart,et al.  Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments , 2009 .

[6]  Erdinç Altug,et al.  EKF Based Attitude Estimation and Stabilization of a Quadrotor UAV Using Vanishing Points in Catadioptric Images , 2011, J. Intell. Robotic Syst..

[7]  Pascal Vasseur,et al.  UAV Attitude Computation by Omnidirectional Vision in Urban Environment , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Neil G. Johnson,et al.  Vision-Assisted Control of a Hovering Air Vehicle in an Indoor Setting , 2008 .

[9]  Mohammed Marey,et al.  A Kalman-Filter-Based Method for Pose Estimation in Visual Servoing , 2010, IEEE Transactions on Robotics.

[10]  Roland Siegwart,et al.  Vision based Position Control for MAVs using one single Artificial Landmark , 2010 .

[11]  Pascal Vasseur,et al.  Robust Attitude Estimation with Catadioptric Vision , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[13]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Stefano Soatto,et al.  Visual-inertial navigation, mapping and localization: A scalable real-time causal approach , 2011, Int. J. Robotics Res..

[15]  Robert E. Mahony,et al.  Hovering flight and vertical landing control of a VTOL Unmanned Aerial Vehicle using optical flow , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Roland Siegwart,et al.  Vision Based Position Control for MAVs Using One Single Circular Landmark , 2011, J. Intell. Robotic Syst..

[18]  Camillo J. Taylor,et al.  Control of a Quadrotor Helicopter Using Dual Camera Visual Feedback , 2005, Int. J. Robotics Res..

[19]  Roland Siegwart,et al.  Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[20]  Rogelio Lozano,et al.  Vision-based Position Control of a Two-rotor VTOL miniUAV , 2010, J. Intell. Robotic Syst..

[21]  Jonathan P. How,et al.  Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[22]  Pascal Vasseur,et al.  Omnidirectional vision on UAV for attitude computation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[23]  Pascal Vasseur,et al.  UAV ATTITUDE ESTIMATION BY COMBINING HORIZON-BASED AND HOMOGRAPHY-BASED APPROACHES FOR CATADIOPTRIC IMAGES , 2007 .

[24]  Robert E. Mahony,et al.  Robust Nonlinear Fusion of Inertial and Visual Data for position, velocity and attitude estimation of UAV , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.