RoadTagger: Robust Road Attribute Inference with Graph Neural Networks

Inferring road attributes such as lane count and road type from satellite imagery is challenging. Often, due to the occlusion in satellite imagery and the spatial correlation of road attributes, a road attribute at one position on a road may only be apparent when considering far-away segments of the road. Thus, to robustly infer road attributes, the model must integrate scattered information and capture the spatial correlation of features along roads. Existing solutions that rely on image classifiers fail to capture this correlation, resulting in poor accuracy. We find this failure is caused by a fundamental limitation – the limited effective receptive field of image classifiers.To overcome this limitation, we propose RoadTagger, an end-to-end architecture which combines both Convolutional Neural Networks (CNNs) and Graph Neural Networks (GNNs) to infer road attributes. Using a GNN allows information to propagate on the road network graph and eliminates the receptive field limitation of image classifiers. We evaluate RoadTagger on both a large real-world dataset covering 688 km2 area in 20 U.S. cities and a synthesized dataset. In the evaluation, RoadTagger improves inference accuracy over the CNN image classifier based approaches. In addition, RoadTagger is robust to disruptions in the satellite imagery and is able to learn complicated inductive rules for aggregating scattered information along the road network.

[1]  Jay Taneja,et al.  Assigning a Grade: Accurate Measurement of Road Quality Using Satellite Imagery , 2018, ArXiv.

[2]  F. Bastani,et al.  RoadRunner: improving the precision of road network inference from GPS trajectories , 2018, SIGSPATIAL/GIS.

[3]  Shuhei Hikosaka,et al.  Building Detection from Satellite Imagery using Ensemble of Size-Specific Detectors , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Peter Reinartz,et al.  Aerial LaneNet: Lane-Marking Semantic Segmentation in Aerial Imagery Using Wavelet-Enhanced Cost-Sensitive Symmetric Fully Convolutional Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[5]  David J. DeWitt,et al.  RoadTracer: Automatic Extraction of Road Networks from Aerial Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Raquel Urtasun,et al.  DeepRoadMapper: Extracting Road Topology from Aerial Images , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Shun'ichi Kaneko,et al.  Combining Satellite Imagery and Open Data to Map Road Safety , 2017, AAAI.

[8]  Sanja Fidler,et al.  HD Maps: Fine-Grained Road Segmentation by Parsing Ground and Aerial Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Andy Davis,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[10]  Sanja Fidler,et al.  Enhancing Road Maps by Parsing Aerial Images Around the World , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[12]  Yoshua Bengio,et al.  Gated Feedback Recurrent Neural Networks , 2015, ICML.

[13]  Dieter Pfoser,et al.  A comparison and evaluation of map construction algorithms using vehicle tracking data , 2014, GeoInformatica.

[14]  James Biagioni,et al.  Map inference in the face of noise and disparity , 2012, SIGSPATIAL/GIS.

[15]  John Krumm,et al.  From GPS traces to a routable road map , 2009, GIS.

[16]  Patrick Weber,et al.  OpenStreetMap: User-Generated Street Maps , 2008, IEEE Pervasive Computing.

[17]  Andy Hopper,et al.  Scalable, Distributed, Real-Time Map Generation , 2006, IEEE Pervasive Computing.

[18]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Sofiane Abbar,et al.  Robust Road Map Inference through Network Alignment of Trajectories , 2018, SDM.

[20]  Stefan Edelkamp,et al.  Route Planning and Map Inference with Global Positioning Traces , 2003, Computer Science in Perspective.

[21]  Alexander J. Smola,et al.  Kernels and Regularization on Graphs , 2003, COLT.