Radar and vision sensors calibration for outdoor 3D reconstruction

In this paper we introduce a new geometric calibration algorithm, and a geometric method of 3D reconstruction using a panoramic microwave radar and a camera. These two sensors are complementary, considering the robustness to environmental conditions and depth detection ability of the radar on one hand, and the high spatial resolution of a vision sensor on the other hand. This makes the approach well adapted for large scale outdoor cartography. Firstly, we address the global calibration problem which consists in finding the exact transformation between radar and camera coordinate systems. The method is based on the optimization of a non-linear criterion obtained from a set of radar-to-image target correspondences. Unlike existing methods, no special configuration of the 3D points is required, only the knowledge of inter-targets distance is needed. This makes the method flexible and easy to use by a non expert operator. Secondly, we present a 3D reconstruction method based on sensors geometry. Both methods have been validated with synthetic and real data.

[1]  Michel Dhome,et al.  Monocular Vision for Mobile Robot Localization and Autonomous Navigation , 2007, International Journal of Computer Vision.

[2]  Nanning Zheng,et al.  Integrating Millimeter Wave Radar with a Monocular Vision Sensor for On-Road Obstacle Detection Applications , 2011, Sensors.

[3]  E. S. Kennedy.  A Fifteenth-Century Planetary Computer: al-Kāshī's ``Ṭabaq al-Manāṭeq". II. Longitudes, Distances, and Equations of the Planets , 1952, Isis.

[4]  Pietro Cerri,et al.  Radar-vision fusion for vehicle detection , 2006 .

[5]  Tomás Pajdla,et al.  3D with Kinect , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[6]  Andrea Fossati,et al.  Consumer Depth Cameras for Computer Vision , 2013, Advances in Computer Vision and Pattern Recognition.

[7]  Daniel G. Aliaga,et al.  A Survey of Urban Reconstruction , 2013, Comput. Graph. Forum.

[8]  Ioannis Stamos,et al.  3-D model construction using range and image data , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  P. Cerri,et al.  Obstacle detection and classification fusing radar and vision , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[10]  M. Skolnik,et al.  Introduction to Radar Systems , 2021, Advances in Adaptive Radar Detection and Range Estimation.

[11]  M.O. Monod,et al.  High resolution mapping of the environment with a ground-based radar imager , 2009, 2009 International Radar Conference "Surveillance for a Safer World" (RADAR 2009).

[12]  Corina Kim Schindhelm,et al.  Evaluating SLAM Approaches for Microsoft Kinect , 2012, ICWMC 2012.

[13]  S. Sugimoto,et al.  Obstacle detection using millimeter-wave radar and its visualization on image sequence , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[14]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[15]  Primo Zingaretti,et al.  Complete classification of raw LIDAR data and 3D reconstruction of buildings , 2006, Pattern Analysis and Applications.

[16]  Dwipen Bhagawati,et al.  PHOTOGRAMMETRY AND 3 D RECONSTRUCTION – THE STATE OF THE ART , 2000 .

[17]  Jan-Michael Frahm,et al.  Real-Time Plane-Sweeping Stereo with Multiple Sweeping Directions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Ernst D. Dickmanns,et al.  Radar and Vision Data Fusion for Hybrid Adaptive Cruise Control on Highways , 2001, ICVS.

[19]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[20]  Lang Hong,et al.  Fusion of Doppler Radar and video information for automated traffic surveillance , 2009, 2009 12th International Conference on Information Fusion.