3D reconstruction of road surfaces using an integrated multi-sensory approach

In this paper, we present our experience in building a mobile imaging system that incorporates multi-modality sensors for road surface mapping and inspection applications. Our proposed system leverages 3D laser-range sensors, video cameras, global positioning systems (GPS) and inertial measurement units (IMU) towards the generation of photo-realistic, geometrically accurate, geo-referenced 3D models of road surfaces. Based on our summary of the state-of-the-art systems for a road distress survey, we identify several challenges in the real-time deployment, integration and visualization of the multi-sensor data. Then, we present our data acquisition and processing algorithms as a novel two-stage automation procedure that can meet the accuracy requirements with real-time performance. We provide algorithms for 3D surface reconstruction to process the raw data and deliver detail preserving 3D models that possess accurate depth information for characterization and visualization of cracks as a significant improvement over contemporary commercial video-based vision systems.

[1]  Karsten Opitz,et al.  Hybrid Cubic Bézier Triangle Patches , 1992 .

[2]  Joonki Paik,et al.  Adaptive regularized noise smoothing of dense range image using directional Laplacian operators , 2001, IS&T/SPIE Electronic Imaging.

[3]  Andreas Koschan,et al.  Hybrid self localization for a mobile robotic platform for indoor and outdoor environments , 2005 .

[4]  Bahram Javidi,et al.  A Laser-based 3D Data Acquisition System for the Analysis of Pavement Distress and Roughness , 2004 .

[5]  Ryosuke Shibasaki,et al.  A vehicle-borne urban 3-D acquisition system using single-row laser range scanners , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Thomas S. Huang,et al.  The Effect of Median Filtering on Edge Estimation and Detection , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Fawzi Nashashibi,et al.  Digitizing and 3D modeling of urban environments and roads using vehicle-borne laser scanner system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[8]  Tony DeRose,et al.  8. A Survey of Parametric Scattered Data Fitting Using Triangular Interpolants , 1992, Curve and Surface Design.

[9]  Mate Sršen.  Automatic road analyzer- ARAN , 2002 .

[10]  Ryosuke Shibasaki,et al.  Updating A Digital Geographic Database using Vehicle-borne Laser Scanners and Line Cameras , 2005 .

[11]  Christian Früh,et al.  Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images , 2005, International Journal of Computer Vision.

[12]  Jan Skaloud,et al.  A mobile mapping system for road data capture via a single camera , 2003 .

[13]  Ahmad Abdul Majid,et al.  G/sup 1/ scattered data interpolation with minimized sum of squares of principal curvatures , 2005, International Conference on Computer Graphics, Imaging and Visualization (CGIV'05).

[14]  Hans Hagen,et al.  Curve and Surface Design , 1992 .

[15]  N. El-Sheimy,et al.  VIASAT - A mobile highway survey system of high accuracy , 1993, Proceedings of VNIS '93 - Vehicle Navigation and Information Systems Conference.

[16]  Henri Briand,et al.  One application of neural networks for detection of defects using video data bases: identification of road distresses , 1997, Database and Expert Systems Applications. 8th International Conference, DEXA '97. Proceedings.

[17]  Gary J. Herron,et al.  Smooth closed surfaces with discrete triangular interpolants , 1985, Comput. Aided Geom. Des..

[18]  Ryosuke Shibasaki,et al.  FEATURE EXTRACTION FROM RANGE DATA , 2001 .

[20]  F. Blais,et al.  Automated pavement distress data collection and analysis: a 3-D approach , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[21]  Brian G. Schunck,et al.  A Two-Stage Algorithm for Discontinuity-Preserving Surface Reconstruction , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  John Laurent,et al.  Road surface inspection using laser scanners adapted for the high precision 3D measurements of large flat surfaces , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[23]  Stephen Mann,et al.  Cubic precision Clough-Tocher interpolation , 1999, Comput. Aided Geom. Des..

[24]  Naser El-Sheimy,et al.  VIASAT [VISAT] - a mobile highway survey system of high accuracy , 1993 .

[25]  Heng-Da Cheng,et al.  Novel Approach to Pavement Cracking Detection Based on Fuzzy Set Theory , 1999 .

[26]  C. Tao.  Mobile Mapping Technology for Road Network Data Acquisition , 2001 .