Dynamic Traffic Modeling From Overhead Imagery

Our goal is to use overhead imagery to understand patterns in traffic flow, for instance answering questions such as how fast could you traverse Times Square at 3am on a Sunday. A traditional approach for solving this problem would be to model the speed of each road segment as a function of time. However, this strategy is limited in that a significant amount of data must first be collected before a model can be used and it fails to generalize to new areas. Instead, we propose an automatic approach for generating dynamic maps of traffic speeds using convolutional neural networks. Our method operates on overhead imagery, is conditioned on location and time, and outputs a local motion model that captures likely directions of travel and corresponding travel speeds. To train our model, we take advantage of historical traffic data collected from New York City. Experimental results demonstrate that our method can be applied to generate accurate city-scale traffic models.

[1]  Bistra N. Dilkina,et al.  Large Scale High-Resolution Land Cover Mapping With Multi-Resolution Data , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Leysia Palen,et al.  From Crowdsourced Mapping to Community Mapping: The Post-earthquake Work of OpenStreetMap Haiti , 2014, COOP.

[3]  David C. Anastasiu,et al.  Vehicle Tracking and Speed Estimation from Traffic Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Raquel Urtasun,et al.  DeepRoadMapper: Extracting Road Topology from Aerial Images , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Petros A. Ioannou,et al.  Traffic Flow Prediction for Road Transportation Networks With Limited Traffic Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[6]  Sanja Fidler,et al.  HD Maps: Fine-Grained Road Segmentation by Parsing Ground and Aerial Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Geoffrey E. Hinton,et al.  Learning to Detect Roads in High-Resolution Aerial Images , 2010, ECCV.

[8]  Scott Workman,et al.  Wide-Area Image Geolocalization with Aerial Reference Imagery , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  C. V. Jawahar,et al.  Improved Road Connectivity by Joint Learning of Orientation and Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Xiaoou Tang,et al.  Facial Landmark Detection by Deep Multi-task Learning , 2014, ECCV.

[11]  Eugenio Culurciello,et al.  LinkNet: Exploiting encoder representations for efficient semantic segmentation , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[12]  Chun Liu,et al.  Leveraging Crowdsourced GPS Data for Road Extraction From Aerial Imagery , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Liyuan Liu,et al.  On the Variance of the Adaptive Learning Rate and Beyond , 2019, ICLR.

[14]  Scott Workman,et al.  A Unified Model for Near and Remote Sensing , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  Eric J. Miller,et al.  URBAN TRANSPORTATION PLANNING: A DECISION-ORIENTED APPROACH , 1984 .

[16]  Wei Cao,et al.  When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks , 2018, AAAI.

[17]  J. Sallis,et al.  Environmental correlates of walking and cycling: Findings from the transportation, urban design, and planning literatures , 2003, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[18]  S. Rosenbloom,et al.  American Driving Survey: 2014 – 2015 , 2016 .

[19]  Stephen F. Smith,et al.  SURTRAC: Scalable Urban Traffic Control , 2013 .

[20]  Geoff Boeing,et al.  OSMnx: New Methods for Acquiring, Constructing, Analyzing, and Visualizing Complex Street Networks , 2016, Comput. Environ. Urban Syst..

[21]  Scott Workman,et al.  Understanding and Mapping Natural Beauty , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Daniel Krajzewicz,et al.  Recent Development and Applications of SUMO - Simulation of Urban MObility , 2012 .

[23]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[24]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[25]  D. Schrank,et al.  2012 Urban Mobility Report , 2002 .

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Adam Van Etten,et al.  City-Scale Road Extraction from Satellite Imagery v2: Road Speeds and Travel Times , 2019, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[28]  Ming Wu,et al.  D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[29]  Geoffrey E. Hinton,et al.  Lookahead Optimizer: k steps forward, 1 step back , 2019, NeurIPS.

[30]  Ramesh Raskar,et al.  Deep Learning the City: Quantifying Urban Perception at a Global Scale , 2016, ECCV.

[31]  John M. Levy,et al.  Contemporary Urban Planning , 1988 .

[32]  I. Nourbakhsh,et al.  Mapping disaster zones , 2006, Nature.

[33]  Bolei Zhou,et al.  Places: A 10 Million Image Database for Scene Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Nathan Jacobs,et al.  Remote Estimation of Free-Flow Speeds , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[35]  Stefan Krauss,et al.  MICROSCOPIC MODELING OF TRAFFIC FLOW: INVESTIGATION OF COLLISION FREE VEHICLE DYNAMICS. , 1998 .

[36]  Nathan Jacobs,et al.  A weakly supervised approach for estimating spatial density functions from high-resolution satellite imagery , 2018, SIGSPATIAL/GIS.

[37]  Reginald R. Souleyrette,et al.  FARSA: Fully Automated Roadway Safety Assessment , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[38]  Marta C. González,et al.  Using Convolutional Networks and Satellite Imagery to Identify Patterns in Urban Environments at a Large Scale , 2017, KDD.