UAV Downwash Dynamic Texture Features for Terrain Classification on Autonomous Navigation

The information generated by a computer vision system capable of labelling a land surface as water, vegetation, soil or other type, can be used for mapping and decision making. For example, an unmanned aerial vehicle (UAV) can use it to find a suitable landing position or to cooperate with other robots to navigate across an unknown region. Previous works on terrain classification from RGB images taken onboard of UAVs shown that only static pixel-based features were tested with a considerable classification error. This paper proposes a robust and efficient computer vision algorithm capable of classifying the terrain from RGB images with improved accuracy. The algorithm complement the static image features with dynamic texture patterns produced by UAVs rotors downwash effect (visible at lower altitudes) and machine learning methods to classify the underlying terrain. The system is validated using videos acquired onboard of a UAV.

[1]  Yasmina Bestaoui Sebbane Intelligent Autonomy of UAVs: Advanced Missions and Future Use , 2018 .

[2]  Jürgen Schmidhuber,et al.  A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots , 2016, IEEE Robotics and Automation Letters.

[3]  Jianhua Gong,et al.  UAV Remote Sensing for Urban Vegetation Mapping Using Random Forest and Texture Analysis , 2015, Remote. Sens..

[4]  Jose Barata,et al.  Water detection from downwash-induced optical flow for a multirotor UAV , 2015, OCEANS 2015 - MTS/IEEE Washington.

[5]  L. Wallace,et al.  Assessment of Forest Structure Using Two UAV Techniques: A Comparison of Airborne Laser Scanning and Structure from Motion (SfM) Point Clouds , 2016 .

[6]  P. Ćwiąkała,et al.  Comparison of low-altitude UAV photogrammetry with terrestrial laser scanning as data-source methods for terrain covered in low vegetation , 2017 .

[7]  Fatemeh Ebadi,et al.  Road Terrain detection and Classification algorithm based on the Color Feature extraction , 2017, 2017 Artificial Intelligence and Robotics (IRANOPEN).

[8]  Andreas Zell,et al.  Grid-based visual terrain classification for outdoor robots using local features , 2011, 2011 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS) Proceedings.

[9]  Jin Zhang,et al.  An overview and comparison of machine-learning techniques for classification purposes in digital soil mapping , 2016 .

[10]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[11]  Rita Almeida Ribeiro,et al.  Land Cover Classification from Multispectral Data Using Computational Intelligence Tools: A Comparative Study , 2017, Inf..

[12]  Wai Yeung Yan,et al.  Urban land cover classification using airborne LiDAR data: A review , 2015 .

[13]  José Barata,et al.  An autonomous surface-aerial marsupial robotic team for riverine environmental monitoring: Benefiting from coordinated aerial, underwater, and surface level perception , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).