Structure From Motion Technique for Scene Detection Using Autonomous Drone Navigation

A method is presented for scene detection and estimation using high-resolution imagery acquired through autonomous drone navigation aided with landmark detection and recognition. The proposed system comprises a drone platform that facilitates efficient autonomous flight; it can capture images and provide real-time video streaming of the ground cover using a camera equipped with a 14-megapixel CMOS sensor and a fish-eye lens. In addition, landmark detection and recognition was performed by applying the histogram of oriented gradients and linear support vector machine methods on each frame of the video stream. The high spatial resolution of the acquired drone images makes the detection and interpretation of environments less complicated. First, through image processing, orthomosaic images and 3-D environment reconstruction (point clouds) of the scene are generated from a set of drone images by using an automatic photogrammetric technique called “structure from motion.” Subsequently, an unsupervised classification method is used to detect and differentiate environmental classes (scene interpretation) in the target or investigated area by using the high-resolution images. Finally, the results of the proposed method are evaluated by comparing them against ground-truth points.

[1]  Sebastian Magierowski,et al.  Vehicle Routing Problems for Drone Delivery , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  A. Ahmad,et al.  Analysis of Landsat 5 TM data of Malaysian land covers using ISODATA clustering technique , 2012, 2012 IEEE Asia-Pacific Conference on Applied Electromagnetics (APACE).

[3]  Hongying Liu,et al.  An improved ISODATA algorithm for hyperspectral image classification , 2014, 2014 7th International Congress on Image and Signal Processing.

[4]  Manabu Watanabe,et al.  Fusion between UAV-SFM and terrestrial laser scanner for field validation of satellite remote sensing , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[5]  Mingyue Ding,et al.  Route Planning for Unmanned Aerial Vehicle (UAV) on the Sea Using Hybrid Differential Evolution and Quantum-Behaved Particle Swarm Optimization , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  J. M.R,et al.  UAV-based remote sensing of the Super-Sauze landslide : Evaluation and results , 2014 .

[7]  Henri Maître,et al.  Kernel MDL to Determine the Number of Clusters , 2007, MLDM.

[8]  Ma Cai-hong,et al.  A Hybrid PSO-ISODATA Algorithm for Remote Sensing Image Segmentation , 2012, 2012 International Conference on Industrial Control and Electronics Engineering.

[9]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  J. Travelletti,et al.  UAV-based remote sensing of the Super-Sauze landslide : evaluation and results. , 2012 .

[11]  Ronen Kadmon,et al.  Remote Sensing and Image Processing , 2001 .

[12]  F. Nex,et al.  UAV for 3D mapping applications: a review , 2014 .

[13]  Benjamin Ranft 3D perception for autonomous navigation of a low-cost MAV using minimal landmarks , 2013 .

[14]  Friedrich Fraundorfer Building and site reconstruction from small scale unmanned aerial vehicles (UAV's) , 2015, 2015 Joint Urban Remote Sensing Event (JURSE).

[15]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Huosheng Hu,et al.  3-D Laser-Based Multiclass and Multiview Object Detection in Cluttered Indoor Scenes , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Sahar A. El Rahman Hyperspectral Imaging Classification Using ISODATA Algorithm: Big Data Challenge , 2015, 2015 Fifth International Conference on e-Learning (econf).

[18]  Yunhao Chen,et al.  An Object-Oriented Semantic Clustering Algorithm for High-Resolution Remote Sensing Images Using the Aspect Model , 2011, IEEE Geoscience and Remote Sensing Letters.

[19]  Zhiheng Wang,et al.  Bottom-Up Merging Segmentation for Color Images With Complex Areas , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  Dimitris N. Metaxas,et al.  Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions , 2003, IEEE Transactions on Medical Imaging.

[21]  Matthew A. Brown,et al.  Unsupervised 3D object recognition and reconstruction in unordered datasets , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[22]  Huosheng Hu,et al.  3-D-Laser-Based Scene Measurement and Place Recognition for Mobile Robots in Dynamic Indoor Environments , 2013, IEEE Transactions on Instrumentation and Measurement.

[23]  Farid Melgani,et al.  Detecting Cars in UAV Images With a Catalog-Based Approach , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Hui Wang,et al.  Automated mosaicking of UAV images based on SFM method , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[25]  Jing Li,et al.  Unsupervised Detection of Earthquake-Triggered Roof-Holes From UAV Images Using Joint Color and Shape Features , 2015, IEEE Geoscience and Remote Sensing Letters.