论文信息 - THE NEW ADVANCED PROTOTYPE OF AIRBORNE VISUAL CONTROL OF A GROUND ROBOT

THE NEW ADVANCED PROTOTYPE OF AIRBORNE VISUAL CONTROL OF A GROUND ROBOT

Unmanned autonomous robots will be widely used very soon for land use, treatment, and monitoring. The paper addresses the problem of visual navigation of ground robots using a camera positioned at a certain elevation above the confined area. The main idea is that robot’s “eyes” is not located on the robot but are independent autonomous system. As a result, the “eyes” can go up and observe the robot from above. This patented technology of airborne vision-based control of ground robots is already described previously in "International Journal of GEOMATE" and Geomate2019 conference paper (Ehrenfeld et al., 2020). There was described in detail the small toy prototype with very simple algorithms and very shortly the next more complex prototype. In the current paper detailed algorithms for navigation and control of this complex prototype is presented. The system consists of the USB camera on the tower (4 meters) connected to the computer which controls the big ground robot by sending Wi-Fi commands. For navigation (recognition of the ground robot, finding its position and orientation) was used deep learning (artificial neural network). It was demonstrated that this robot can pass two main tests: travelling along some predefined path and random walk inside of some predefined boundary.

Oleg Kupervasser

[1] G LoweDavid,et al. Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2] Geoffrey E. Hinton,et al. ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3] Roberto Cipolla,et al. Geometric Loss Functions for Camera Pose Regression with Deep Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4] Roberto Cipolla,et al. PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5] K. Djaja,et al. The integration of geography information system (GIS) and global navigation satelite system-real time kinematic (GNSS-RTK) for land use monitoring , 2017 .

[6] Oleg Kupervasser,et al. Algorithms Developed for Two Porotypes of Airborne Vision-Based Control of Ground Robots , 2019 .

[7] U. Nunes,et al. Autonomous wheelchair for disabled people , 1997, ISIE '97 Proceeding of the IEEE International Symposium on Industrial Electronics.

[8] Oleg Kupervasser,et al. Visual navigation for airborne control of ground robots from tethered platform: creation of the first prototype , 2018, ArXiv.

[9] Oleg Kupervasser,et al. Robust positioning of drones for land use monitoring in strong terrain relief using vision-based navigation , 2018, ArXiv.