Urban Scene Analysis with Mobile Mapping Technology

Abstract: Mobile mapping technology (MMT) involves the dynamic digitization at very high spatial resolution of complex environments (mainly urban environments) using a mobile terrestrial platform. The aim is to acquire very precise and very accurate georeferenced data of objects of interest as well as in fine data for applications which require this level of geometric precision (3D city modeling, pedestrian and vehicle detection for autonomous navigation, digitizing roadway property, archaeological excavations, etc.). This chapter will focus on mobile mapping from roads, but similar methods have also been developed for digitizing rail networks through the use of trains equipped with similar sensors.

[1]  Uwe Stilla,et al.  Photogrammetric Image Analysis PIA11 , 2011 .

[2]  Jan Skaloud,et al.  A mobile mapping system for road data capture via a single camera , 2003 .

[3]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[4]  Marc Pollefeys,et al.  Joint 3D Scene Reconstruction and Class Segmentation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Nicolas David,et al.  Towards 3D lidar point cloud registration improvement using optimal neighborhood knowledge , 2013 .

[6]  Bruno Vallet,et al.  Facade Reconstruction with Generalized 2.5d Grids , 2013 .

[7]  Nicolas Seube,et al.  A positioning free calibration method for mobile laser scanning applications , 2013 .

[8]  Martial Hebert,et al.  Co-inference for Multi-modal Scene Analysis , 2012, ECCV.

[9]  Ioannis Stamos,et al.  Automatic Kronecker Product Model Based Detection of Repeated Patterns in 2D Urban Images , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Luc Van Gool,et al.  Towards semantic city models , 2013 .

[12]  Gordon Petrie,et al.  Terrestrial Laser Scanners , 2017 .

[13]  F. Goulette,et al.  An integrated on-board laser range sensing system for on-the-way city and road modelling , 2006 .

[14]  Wen Xiao,et al.  Extracting Mobile Objects in Images Using a Velodyne LIDAR Point Cloud , 2015 .

[15]  Ahmad Kamal Aijazi,et al.  Automatic Removal of Imperfections and Change Detection for Accurate 3D Urban Cartography by Classification and Incremental Updating , 2013, Remote. Sens..

[16]  Bruno Vallet,et al.  Detection and 3D reconstruction of traffic signs from multiple view color images , 2013 .

[17]  Andrés Serna,et al.  Detection, segmentation and classification of 3D urban objects using mathematical morphology and supervised learning , 2014 .

[18]  Florent Lafarge,et al.  LOD Generation for Urban Scenes , 2015, ACM Trans. Graph..

[19]  Dorota A. Grejner-Brzezinska,et al.  Positioning Accuracy of the GPSVan , 1996 .

[20]  Hiroaki Date,et al.  Accurate registration of MMS point clouds of urban areas using trajectory , 2013 .

[21]  James M. Rehg,et al.  Joint Semantic Segmentation and 3D Reconstruction from Monocular Video , 2014, ECCV.

[22]  Xiaozhi Qu,et al.  Vehicle localization using mono-camera and geo-referenced traffic signs , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[23]  Konrad Schindler,et al.  IMPLICIT SHAPE MODELS FOR OBJECT DETECTION IN 3D POINT CLOUDS , 2012, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[24]  Bruno Vallet,et al.  TREES DETECTION FROM LASER POINT CLOUDS ACQUIRED IN DENSE URBAN AREAS BY A MOBILE MAPPING SYSTEM , 2012 .

[25]  Konrad Schindler,et al.  Are Cars Just 3D Boxes? Jointly Estimating the 3D Shape of Multiple Objects , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Bruno Vallet,et al.  TerraMobilita/iQmulus urban point cloud analysis benchmark , 2015, Comput. Graph..

[27]  Martin Lauer,et al.  3D Traffic Scene Understanding From Movable Platforms , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  O. Tournaire,et al.  PANORAMA-BASED CAMERA CALIBRATION , 2010 .

[29]  Nicolas David,et al.  Registration of terrestrial mobile laser data on 2D or 3D geographic database by use of a non-rigid ICP approach. , 2013 .

[30]  Bahman Soheilian,et al.  Road Marking Extraction Using a MODEL&DATA-DRIVEN Rj-Mcmc , 2015 .

[31]  N. David,et al.  Stereopolis II: A multi-purpose and multi-sensor 3D mobile mapping system for street visualisation and 3D metrology , 2014 .

[32]  François Goulette,et al.  Paris-rue-Madame Database - A 3D Mobile Laser Scanner Dataset for Benchmarking Urban Detection, Segmentation and Classification Methods , 2014, ICPRAM.

[33]  Martin Weinmann,et al.  Visual Features - From Early Concepts to Modern Computer Vision , 2013, Advanced Topics in Computer Vision.

[34]  Juha Hyyppä,et al.  ROAD ENVIRONMENT MAPPING SYSTEM OF THE FINNISH GEODETIC INSTITUTE - FGI ROAMER - , 2007 .

[35]  C. Mallet,et al.  Airborne LiDAR Data Processing , 2016 .

[36]  Luc Van Gool,et al.  3D all the way: Semantic segmentation of urban scenes from start to end in 3D , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Daniel Cohen-Or,et al.  2D-3D fusion for layer decomposition of urban facades , 2011, 2011 International Conference on Computer Vision.

[38]  Peter F. Sturm,et al.  A Generic Concept for Camera Calibration , 2004, ECCV.

[39]  Renaud Marlet,et al.  A MRF shape prior for facade parsing with occlusions , 2015, CVPR.

[40]  George Vosselman,et al.  Tree modelling from mobile laser scanning data‐sets , 2011 .

[41]  Martial Hebert,et al.  Contextual classification with functional Max-Margin Markov Networks , 2009, CVPR.

[42]  Sanja Fidler,et al.  Holistic 3D scene understanding from a single geo-tagged image , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Bahman Soheilian,et al.  Towards a sub-decimetric georeferencing of ground-based mobile mapping systems in urban areas : Matching ground-based and aerial-based imagery using roadmarks , 2007 .

[44]  Andrés Serna,et al.  Urban accessibility diagnosis from mobile laser scanning data , 2013 .

[45]  Martial Hebert,et al.  3-D scene analysis via sequenced predictions over points and regions , 2011, 2011 IEEE International Conference on Robotics and Automation.

[46]  B. Soheilian,et al.  CIRCULAR ROAD SIGN EXTRACTION FROM STREET LEVEL IMAGES USING COLOUR, SHAPE AND TEXTURE DATABASE MAPS , 2009 .

[47]  Bruno Vallet,et al.  COMBINATORIAL CLUSTERING AND ITS APPLICATION TO 3D POLYGONAL TRAFFIC SIGN RECONSTRUCTION FROM MULTIPLE IMAGES , 2014 .

[48]  J. Delvit,et al.  Digital Terrain Models from Optical Images , 2016 .

[49]  Nicolas Paparoditis,et al.  Off-Line VS. On-Line Calibration of a Panoramic-Based Mobile Mapping System , 2012 .

[50]  Bruno Vallet,et al.  Fast and Accurate Visibility Computation in Urban Scenes , 2013 .

[51]  V. Wichmann,et al.  Eigenvalue and graph-based object extraction from mobile laser scanning point clouds , 2013 .

[52]  Marc Pollefeys,et al.  Geometric Change Detection in Urban Environments Using Images , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Michel Dhome,et al.  Real-time vehicle global localisation with a single camera in dense urban areas: Exploitation of coarse 3D city models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[54]  Uwe Stilla,et al.  Thermal leakage detection on building facades using infrared textures generated by mobile mapping , 2009, 2009 Joint Urban Remote Sensing Event.

[55]  Bruno Vallet,et al.  STREAMED VERTICAL RECTANGLE DETECTION IN TERRESTRIAL LASER SCANS FOR FACADE DATABASE PRODUCTION , 2012 .

[56]  Juha Hyyppä,et al.  Detection of Vertical Pole-Like Objects in a Road Environment Using Vehicle-Based Laser Scanning Data , 2010, Remote. Sens..

[57]  Stefan Hinz,et al.  Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers , 2015 .

[58]  Pierre Alliez,et al.  State of the Art in Surface Reconstruction from Point Clouds , 2014, Eurographics.

[59]  Nikos Paragios,et al.  Random Exploration of the Procedural Space for Single-View 3D Modeling of Buildings , 2011, International Journal of Computer Vision.

[60]  Bruno Vallet,et al.  Street environment change detection from mobile laser scanning point clouds , 2015 .

[61]  F. Tupin,et al.  The Principles of DTM Reconstruction from SAR Images , 2016 .

[62]  Bahman Soheilian,et al.  MULTI-VIEW 3D CIRCULAR TARGET RECONSTRUCTION WITH UNCERTAINTY ANALYSIS , 2014 .