Rapid self-localization of robot based on omnidirectional vision technology

In this paper, we propose a self-localization method for a soccer robot using an omnidirectional camera. Based on the projective geometry of the omnidirectional visual system, the image distortion from the original omnidirectional image can be completely corrected, so the robot can quickly localize itself on the playing field. First, we transform the distorted omnidirectional image to a distortion-free unwrapped image of the soccer field by projective geometry. The obtained image makes the sequent field recognizable and the self-localization of the robot more convenient and accurate. Then, by geometric invariants, the correspondence between the unwrapped image and the model of the playing field is constructed. Next, the homography theory is applied to get the precise location and orientation of the robot. The simulation and experimental results show that the proposed method can quickly and accurately determine the position and azimuth of the soccer robot and the distance between two objects on the playing field.

[1]  David Fofi,et al.  Visual tracking with omnidirectional cameras: an efficient approach , 2011 .

[2]  Pavel Krömer,et al.  Scan Matching by Cross-Correlation and Differential Evolution , 2019 .

[3]  Hiroshi Ishiguro,et al.  Omni-Directional Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Yasushi Yagi,et al.  Real-Time Omnidirectional Image Sensors , 2004, International Journal of Computer Vision.

[5]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[6]  S. Amirhassan Monadjemi,et al.  Modeling and implementation of a fully autonomous soccer robot based on omni-directional vision system , 2010, Ind. Robot.

[7]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Noel E. O'Connor,et al.  Player detection in field sports , 2018, Machine Vision and Applications.

[9]  Ching-Chang Wong,et al.  Localization of mobile robots via an enhanced particle filter , 2010, 2010 IEEE Instrumentation & Measurement Technology Conference Proceedings.

[10]  Armando J. Pinho,et al.  An efficient omnidirectional vision system for soccer robots: From calibration to object detection , 2011 .

[11]  R. Sablatnig,et al.  Line-based landmark recognition for self-localization of soccer robots , 2005, Proceedings of the IEEE Symposium on Emerging Technologies, 2005..

[12]  Shunsuke Kamijo,et al.  Estimating Autonomous Vehicle Localization Error Using 2D Geographic Information , 2019, ISPRS Int. J. Geo Inf..

[13]  Simone Gasparini,et al.  Camera Models and Fundamental Concepts Used in Geometric Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[14]  Guo Lei,et al.  Recognition of planar objects in 3-D space from single perspective views using cross ratio , 1990, IEEE Trans. Robotics Autom..

[15]  Raquel Frizera Vassallo,et al.  Self-Localization Based on Visual Lane Marking Maps: An Accurate Low-Cost Approach for Autonomous Driving , 2018, IEEE Transactions on Intelligent Transportation Systems.

[16]  Shu-Yin Chiang,et al.  Self-localization for an autonomous mobile robot based on an omni-directional vision system , 2013, Electronic Imaging.

[17]  Huimin Lu,et al.  Robust and real-time self-localization based on omnidirectional vision for soccer robots , 2013, Adv. Robotics.

[18]  In-So Kweon,et al.  Metric localization using a single artificial landmark for indoor mobile robots , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  W. Burgard,et al.  Markov Localization for Mobile Robots in Dynamic Environments , 1999, J. Artif. Intell. Res..

[20]  Chen-Chien James Hsu,et al.  Dual-circle self-localization for soccer robots with omnidirectional vision , 2012 .

[21]  Zhiqiang Zheng,et al.  A robust omnidirectional vision sensor for soccer robots , 2011 .

[22]  Antonio Criminisi,et al.  Accurate Visual Metrology from Single and Multiple Uncalibrated Images , 2001, Distinguished Dissertations.

[23]  Michel Dhome,et al.  Localization of 3D objects using model-constrained SLAM , 2018, Machine Vision and Applications.

[24]  Luis Puig,et al.  Calibration of Central Catadioptric Cameras Using a DLT-Like Approach , 2011, International Journal of Computer Vision.

[25]  Otman A. Basir,et al.  GPS Localization Accuracy Classification: A Context-Based Approach , 2013, IEEE Transactions on Intelligent Transportation Systems.

[26]  Huei-Yung Lin,et al.  Geometric constraints for robot navigation using omnidirectional camera , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[27]  Chu Kiong Loo,et al.  Omnidirectional Surveillance System for Digital Home Security , 2009, 2009 International Conference on Signal Acquisition and Processing.

[28]  Luis Puig,et al.  Calibration of omnidirectional cameras in practice: A comparison of methods , 2012, Comput. Vis. Image Underst..

[29]  António Paulo Moreira,et al.  Map-Matching Algorithms for Robot Self-Localization: A Comparison Between Perfect Match, Iterative Closest Point and Normal Distributions Transform , 2018, Journal of Intelligent & Robotic Systems.

[30]  Wen-Hsiang Tsai,et al.  Real-Time Security Monitoring Around a Video Surveillance Vehicle With a Pair of Two-Camera Omni-Imaging Devices , 2011, IEEE Transactions on Vehicular Technology.

[31]  Christopher Burbridge,et al.  Instantaneous robot self-localization and motion estimation with omnidirectional vision , 2007, Robotics Auton. Syst..

[32]  Pascal Frossard,et al.  Joint Registration and Super-Resolution With Omnidirectional Images , 2011, IEEE Transactions on Image Processing.

[33]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[34]  Richard Szeliski,et al.  3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo , 2004, International Journal of Computer Vision.

[35]  Kai Chen,et al.  Self-Localization of Parking Robots Using Square-Like Landmarks , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[36]  Jun Zhou,et al.  A self-localization method through pose point matching for autonomous soccer robot based on omni-vision , 2009, 2009 9th International Conference on Electronic Measurement & Instruments.

[37]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[38]  Qijun Chen,et al.  A novel parameter estimation algorithm based on RANSAC for precise omnidirectional image unwrapping , 2011, International Conference on Information Science and Technology.

[39]  Mingui Sun,et al.  Robust Robot Pose Estimation for Challenging Scenes With an RGB-D Camera , 2019, IEEE Sensors Journal.

[40]  Huaqing Min,et al.  A New Omni-vision Based Self-localization Method for Soccer Robot , 2009, 2009 WRI World Congress on Software Engineering.

[41]  Fu-Chao Wu,et al.  An Easy Calibration Method for Central Catadioptric Cameras , 2007 .

[42]  Tae-Koo Kang,et al.  Local Obstacle Avoidance Using Obstacle-Dependent Gaussian Potential Field for Robot Soccer , 2015, RiTA.

[43]  Davide Scaramuzza,et al.  Calibration by Correlation Using Metric Embedding from Nonmetric Similarities , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Gang Huang,et al.  Integration of GPS, Monocular Vision, and High Definition (HD) Map for Accurate Vehicle Localization , 2018, Sensors.

[45]  Kang-Hyun Jo,et al.  A geometry-based 3D reconstruction from a single omnidirectional image , 2013, The 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision.

[46]  Baoyong Yin,et al.  Robot Self-localization with Optimized Error Minimizing for Soccer Contest , 2011, J. Comput..

[47]  Michal R. Nowicki,et al.  Modeling spatial uncertainty of point features in feature-based RGB-D SLAM , 2018, Machine Vision and Applications.

[48]  Narendra Ahuja,et al.  Multiview panoramic cameras using mirror pyramids , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Wei Li,et al.  3D scene reconstruction based on improved ICP algorithm , 2020, Microprocess. Microsystems.

[50]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[51]  Jianwu Dang,et al.  Multimodal sensory fusion for soccer robot self-localization based on long short-term memory recurrent neural network , 2017, J. Ambient Intell. Humaniz. Comput..

[52]  M Aria.  Real-Time 2D Mapping and Localization Algorithms for Mobile Robot Applications , 2019 .

[53]  Hyun Myung,et al.  Image-based localization using prior map database and Monte Carlo Localization , 2014, 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[54]  Tsu-Tian Lee,et al.  Design and implementation of adaptive dynamic controllers for wheeled mobile robots , 2013, 2013 International Conference on System Science and Engineering (ICSSE).

[55]  Pedro U. Lima,et al.  Omni-directional catadioptric vision for soccer robots , 2001, Robotics Auton. Syst..

[56]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..

[57]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).