Autonomous indoor helicopter flight using a single onboard camera

We consider the problem of autonomously flying a helicopter in indoor environments. Navigation in indoor settings poses two major challenges. First, real-time perception and response is crucial because of the high presence of obstacles. Second, the limited free space in such a setting places severe restrictions on the size of the aerial vehicle, resulting in a frugal payload budget. We autonomously fly a miniature RC helicopter in small known environments using an on-board light-weight camera as the only sensor. We use an algorithm that combines data-driven image classification with optical flow techniques on the images captured by the camera to achieve real-time 3D localization and navigation. We perform successful autonomous test flights along trajectories in two different indoor settings. Our results demonstrate that our method is capable of autonomous flight even in narrow indoor spaces with sharp corners.

[1]  Nikolaos Papanikolopoulos,et al.  Estimating 3D Positions and Velocities of Projectiles from Monocular Views , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Roland Siegwart,et al.  From the Test Benches to the First Prototype of the muFly Micro Helicopter , 2009, J. Intell. Robotic Syst..

[3]  Ian D. Reid,et al.  An image-to-map loop closing method for monocular SLAM , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[5]  Ashutosh Saxena,et al.  Learning to open new doors , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Rina Panigrahy,et al.  An Improved Algorithm Finding Nearest Neighbor Using Kd-trees , 2008, LATIN.

[7]  Selcuk Bayraktar,et al.  Aggressive landing maneuvers for unmanned aerial vehicles , 2006 .

[8]  Pieter Abbeel,et al.  Learning for control from multiple demonstrations , 2008, ICML '08.

[9]  Ashutosh Saxena,et al.  High speed obstacle avoidance using monocular vision and reinforcement learning , 2005, ICML.

[10]  Takuya Kinoshita,et al.  Vision-based guidance control of a small-scale unmanned helicopter , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Neil G. Johnson,et al.  Vision-Assisted Control of a Hovering Air Vehicle in an Indoor Setting , 2008 .

[12]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[13]  John Langford,et al.  Cover trees for nearest neighbor , 2006, ICML.

[14]  Jean-Christophe Zufferey,et al.  Toward indoor flying robots , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Roland Siegwart,et al.  Backstepping and Sliding-mode Techniques Applied to an Indoor Micro Quadrotor , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[16]  Glenn P. Tournier,et al.  Estimation and Control of a Quadrotor Vehicle Using Monocular Vision and Moire Patterns , 2006 .

[17]  S. Shankar Sastry,et al.  Flapping flight for biomimetic robotic insects: part II-flight control design , 2006, IEEE Transactions on Robotics.

[18]  Peter I. Corke,et al.  Two Seconds to Touchdown - Vision-Based Controlled Forced Landing , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Eric Feron,et al.  Control Logic for Automated Aerobatic Flight of a Miniature Helicopter , 2002 .

[20]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[21]  Antonio Torralba,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 80 Million Tiny Images: a Large Dataset for Non-parametric Object and Scene Recognition , 2022 .

[22]  Nicholas Roy,et al.  Planning in information space for a quadrotor helicopter in a GPS-denied environment , 2008, 2008 IEEE International Conference on Robotics and Automation.

[23]  Dario Floreano,et al.  Quadrotor Using Minimal Sensing For Autonomous Indoor Flight , 2007 .

[24]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[25]  Pieter Abbeel,et al.  An Application of Reinforcement Learning to Aerobatic Helicopter Flight , 2006, NIPS.

[26]  Wolfram Burgard,et al.  Visual SLAM for Flying Vehicles , 2008, IEEE Transactions on Robotics.