Autonomous navigation and environment modeling for MAVs in 3-D enclosed industrial environments

In many applications, the industrial environments are typically 3-D indoor spaces enclosed by shell style structures, which are highly complex with known or unknown non-convex obstacles. GPS signal is unreliable or even unavailable inside, which poses significant technical challenges for the state estimation of micro aerial vehicles (MAVs) performing exploration and modeling tasks in such environments. In this paper, requirements and challenges for 3-D enclosed industrial environments exploration are analyzed firstly, and then state-of-art developments of MAV systems, environment modeling, visual navigation and guidance technologies are reviewed. A robust RGB-D odometry is introduced into the system to provide airborne 6-DOF state estimates of the MAV, which are fused with inertial measurements. Then the fused state information is used to assist the RGB-D based real time 3-D environment modeling. An improved closed-loop RRT based path planning approach (BI-RRT) is developed for information-efficient environment explorations. A flight experimental platform is constructed and the proposed system is validated in flight experiments.

[1]  J. How,et al.  Coordination and control experiments on a multi-vehicle testbed , 2004, Proceedings of the 2004 American Control Conference.

[2]  Jonathan P. How,et al.  Real-Time Motion Planning With Applications to Autonomous Urban Driving , 2009, IEEE Transactions on Control Systems Technology.

[3]  Chirag Amrutbhai Patel BUILDING A TESTBED FOR MINI QUADROTOR UNMANNED AERIAL VEHICLE WITH PROTECTIVE SHROUD , 2006 .

[4]  Albert S. Huang,et al.  Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera , 2011, ISRR.

[5]  Vijay Kumar,et al.  Trajectory generation and control for precise aggressive maneuvers with quadrotors , 2012, Int. J. Robotics Res..

[6]  Steven M. LaValle,et al.  Current Issues in Sampling-Based Motion Planning , 2005, ISRR.

[7]  B. Bethke,et al.  Real-time indoor autonomous vehicle test environment , 2008, IEEE Control Systems.

[8]  Jonathan P. How,et al.  Motion Planning in Complex Environments using Closed-loop Prediction , 2008 .

[9]  A. Tsourdos,et al.  Robust nonlinear filtering for INS/GPS UAV localization , 2008, 2008 16th Mediterranean Conference on Control and Automation.

[10]  Roland Siegwart,et al.  Robust embedded egomotion estimation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Jonathan P. How,et al.  The MIT Indoor Multi-Vehicle Flight Testbed , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Vijay Kumar,et al.  Cooperative Grasping and Transport Using Multiple Quadrotors , 2010, DARS.

[14]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Vijay Kumar,et al.  Cooperative manipulation and transportation with aerial robots , 2009, Auton. Robots.

[16]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[17]  J. How,et al.  Information-rich Path Planning with General Constraints using Rapidly-exploring Random Trees , 2010 .

[18]  N. Roy,et al.  The Belief Roadmap: Efficient Planning in Belief Space by Factoring the Covariance , 2009, Int. J. Robotics Res..

[19]  Nicholas Roy,et al.  Autonomous Flight in Unknown Indoor Environments , 2009 .

[20]  Nicholas Roy,et al.  Planning in information space for a quadrotor helicopter in a GPS-denied environment , 2008, 2008 IEEE International Conference on Robotics and Automation.

[21]  John J. Leonard,et al.  Kintinuous: Spatially Extended KinectFusion , 2012, AAAI 2012.

[22]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[23]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[24]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[25]  Steven L. Waslander,et al.  Kinodynamic Motion Planning for Holonomic UAVs in Complex 3D Environments , 2010 .

[26]  Vijay Kumar,et al.  Autonomous indoor 3D exploration with a micro-aerial vehicle , 2012, 2012 IEEE International Conference on Robotics and Automation.

[27]  Vijay Kumar,et al.  The GRASP Multiple Micro-UAV Testbed , 2010, IEEE Robotics & Automation Magazine.

[28]  Roland Siegwart,et al.  Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[29]  Nicholas Roy,et al.  RANGE–Robust autonomous navigation in GPS‐denied environments , 2011, J. Field Robotics.

[30]  Sanjiv Singh,et al.  Motion Estimation from Image and Inertial Measurements , 2004, Int. J. Robotics Res..

[31]  Eric Dorveaux,et al.  Magneto-inertial navigation: principles and application to an indoor pedometer , 2011 .

[32]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[33]  Kostas E. Bekris,et al.  Sampling-based roadmap of trees for parallel motion planning , 2005, IEEE Transactions on Robotics.

[34]  Lydia E. Kavraki,et al.  Probabilistic roadmaps for path planning in high-dimensional configuration spaces , 1996, IEEE Trans. Robotics Autom..

[35]  Roland Siegwart,et al.  Real-time metric state estimation for modular vision-inertial systems , 2011, 2011 IEEE International Conference on Robotics and Automation.

[36]  Lydia E. Kavraki,et al.  Path planning using lazy PRM , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[37]  Jonathan P. How,et al.  Indoor Multi-Vehicle Flight Testbed for Fault Detection, Isolation, and Recovery , 2006 .

[38]  Jean-Claude Latombe,et al.  Sensory uncertainty field for mobile robot navigation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[39]  Girish Chowdhary,et al.  Self-Contained Autonomous Indoor Flight with Ranging Sensor Navigation , 2012 .

[40]  Nicolas Petit,et al.  Using magnetic disturbances to improve IMU-based position estimation , 2007, 2007 European Control Conference (ECC).

[41]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[42]  Nicholas Roy,et al.  Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments , 2009, Defense + Commercial Sensing.

[43]  Abraham Bachrach,et al.  Autonomous flight in unstructured and unknown indoor environments , 2009 .

[44]  Roland Siegwart,et al.  Versatile distributed pose estimation and sensor self-calibration for an autonomous MAV , 2012, 2012 IEEE International Conference on Robotics and Automation.

[45]  Nicholas Roy,et al.  State estimation for aggressive flight in GPS-denied environments using onboard sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[46]  Roland Siegwart,et al.  Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[47]  Nicolas Petit,et al.  The Navigation and Control technology inside the AR.Drone micro UAV , 2011 .

[48]  Kemao Peng,et al.  International Conference on Control and Automation ThB 2-4 Guangzhou , CHINA-May 30 to June 1 , 2007 Enhancement of GPS Signals for Automatic Control of a UAV Helicopter System , 2007 .

[49]  Jonathan P. How,et al.  Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[50]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[51]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[52]  Rogelio Lozano,et al.  Combining Stereo Vision and Inertial Navigation System for a Quad-Rotor UAV , 2011, J. Intell. Robotic Syst..