Fast, robust and accurate posture detection algorithm based on Kalman filter and SSD for AGV

Abstract The autonomous navigation technology of mobile robot based on visual sensor has been widely studied by researchers in recent years. Visual sensors, such as Charge-coupled Device (CCD), usually bring severe noise and unpredictable disturbances (including light differences, scene changes, etc.), thus it is necessary to find an adapted detection method to accommodate to the complex missions. Traditional detection model obtains feature characterization manually, which is laborious, time-consuming, mostly depending on researchers experience, and greatly increases the complexity of the recognition procedures. In this paper, we propose a target location strategy Kalman based SSD (K-SSD) utilizing convolution neural network (CNN) to improve the location accuracy and the speed of mobile robot during the automatic navigation. First, one frame of the entire scene is captured by a camera to construct an environment model. Then, a Single Shot MultiBox Detector (SSD) model is trained offline using original images as model input, which can output classes corresponding with their own positions. Finally, we use the Kalman Filter to filter the Gaussian noise to improve the accuracy of location. In the experiments, we use the HUSKY UGV platform to verify the proposed strategy. The results indicate that this algorithm is capable of realizing the fast, robust and accurate posture detection for Gaussian noise and abnormal noise.

[1]  Jan Peters,et al.  Incremental online sparsification for model learning in real-time robot control , 2011, Neurocomputing.

[2]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[3]  Xianjun Shi,et al.  Indoor localization, navigation and mapping for quad-rotor , 2014, Proceedings of 2014 IEEE Chinese Guidance, Navigation and Control Conference.

[4]  Zhan Li,et al.  Valid data based normalized cross-correlation (VDNCC) for topography identification , 2018, Neurocomputing.

[5]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[6]  Xinyu Wu,et al.  A new method of AGV navigation based on Kalman Filter and a magnetic nail localization , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[7]  Shiqiang Hu,et al.  2D path planning with dubins-path-based A∗ algorithm for a fixed-wing UAV , 2017, 2017 3rd IEEE International Conference on Control Science and Systems Engineering (ICCSSE).

[8]  Jianhua Zhang,et al.  Robot path planning in uncertain environment using multi-objective particle swarm optimization , 2013, Neurocomputing.

[9]  Jana Kosecka,et al.  Fast Single Shot Detection and Pose Estimation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[10]  Pratap Tokekar,et al.  Sensor planning for a symbiotic UAV and UGV system for precision agriculture , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Weiyang Lin,et al.  A novel robust algorithm for position and orientation detection based on cascaded deep neural network , 2018, Neurocomputing.

[12]  Xinlei Liu,et al.  A Road Detection Technology Based on Reverse Perspective Transformation , 2016, 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[13]  Jianbin Qiu,et al.  Visual Detection and Two-Dimensional Rotation Control in Zebrafish Larva Heart Microinjection , 2017, IEEE/ASME Transactions on Mechatronics.

[14]  Xinbo Gao,et al.  Video super-resolution with 3D adaptive normalized convolution , 2012, Neurocomputing.

[15]  Li Li,et al.  Visual Servoed Zebrafish Larva Heart Microinjection System , 2017, IEEE Transactions on Industrial Electronics.

[16]  Yoko Sasaki,et al.  GOSELO: Goal-Directed Obstacle and Self-Location Map for Robot Navigation Using Reactive Neural Networks , 2018, IEEE Robotics and Automation Letters.