Automatic extraction of road intersection points from USGS historical map series using deep convolutional neural networks

ABSTRACT Road intersection data have been used across a range of geospatial analyses. However, many datasets dating from before the advent of GIS are only available as historical printed maps. To be analyzed by GIS software, they need to be scanned and transformed into a usable (vector-based) format. Because the number of scanned historical maps is voluminous, automated methods of digitization and transformation are needed. Frequently, these processes are based on computer vision algorithms. However, the key challenges to this are (1) the low conversion accuracy for low quality and visually complex maps, and (2) the selection of optimal parameters. In this paper, we used a region-based deep convolutional neural network-based framework (RCNN) for object detection, in order to automatically identify road intersections in historical maps of several cities in the United States of America. We found that the RCNN approach is more accurate than traditional computer vision algorithms for double-line cartographic representation of the roads, though its accuracy does not surpass all traditional methods used for single-line symbols. The results suggest that the number of errors in the outputs is sensitive to complexity and blurriness of the maps, and to the number of distinct red-green-blue (RGB) combinations within them.

[1]  Richard Alan Peters,et al.  Image Complexity Metrics for Automatic Target Recognizers , 1990 .

[2]  Zinal K. Naik,et al.  A Review: Object Detection using Deep Learning , 2018 .

[3]  Daniel J. Hayes,et al.  The Use of Three-Dimensional Convolutional Neural Networks to Interpret LiDAR for Forest Inventory , 2018, Remote. Sens..

[4]  Garrison W. Cottrell,et al.  Color-to-Grayscale: Does the Method Matter in Image Recognition? , 2012, PloS one.

[5]  Jiebo Luo,et al.  DOTA: A Large-Scale Dataset for Object Detection in Aerial Images , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Kuolin Hsu,et al.  Deep neural networks for precipitation estimation from remotely sensed information , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[7]  James J. Little,et al.  Lightweight convolutional neural networks for player detection and classification , 2018, Comput. Vis. Image Underst..

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Craig A. Knoblock,et al.  Extracting Human Settlement Footprint from Historical Topographic Map Series Using Context-Based Machine Learning , 2017 .

[10]  T. Shimizu,et al.  Protective activity of glycolipid antigen against infection by Leptospira interrogans serovar canicola. , 1990, Journal of general microbiology.

[11]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[12]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Thomas Deselaers,et al.  Measuring the Objectness of Image Windows , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Zhou Yang,et al.  Scene classification of remote sensing image based on deep network and multi-scale features fusion , 2018, Optik.

[15]  Tomaso A. Poggio,et al.  Do Deep Neural Networks Suffer from Crowding? , 2017, NIPS.

[16]  Craig A. Knoblock,et al.  Map Archive Mining: Visual-Analytical Approaches to Explore Large Historical Map Collections , 2018, ISPRS Int. J. Geo Inf..

[17]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Jun Wang,et al.  Road network extraction: a neural-dynamic framework based on deep learning and a finite state machine , 2015 .

[20]  Jesús Chamorro-Martínez,et al.  Diatom autofocusing in brightfield microscopy: a comparative study , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[21]  Chia Y. Han,et al.  P-QRS-T localization in ECG using deep learning , 2018, 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[22]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[23]  Craig A. Knoblock,et al.  Efficient and Robust Graphics Recognition from Historical Maps , 2011, GREC.

[24]  Ye Zhang,et al.  A light and faster regional convolutional neural network for object detection in optical remote sensing images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[25]  Lina J. Karam,et al.  Understanding how image quality affects deep neural networks , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[26]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Justin Salamon,et al.  Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification , 2016, IEEE Signal Processing Letters.

[28]  Xinying Xu,et al.  SR-POD: Sample rotation based on principal-axis orientation distribution for data augmentation in deep object detection , 2018, Cognitive Systems Research.

[29]  Jun Zhang,et al.  Geospatial Object Detection in Remote Sensing Imagery Based on Multiscale Single-Shot Detector with Activated Semantics , 2018, Remote. Sens..

[30]  Kasey Jones,et al.  Residential scene classification for gridded population sampling in developing countries using deep convolutional neural networks on satellite imagery , 2018, International Journal of Health Geographics.

[31]  P Crits-Christoph,et al.  "Early withdrawal from mental health treatment: Implications for psychotherapy practice": Correction to Barrett et al (2008). , 2009, Psychotherapy.

[32]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[33]  Huanxin Zou,et al.  Toward Fast and Accurate Vehicle Detection in Aerial Images Using Coupled Region-Based Convolutional Neural Networks , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Derek Anderson,et al.  Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community , 2017 .

[35]  Craig A. Knoblock,et al.  Automatically and Accurately Conflating Raster Maps with Orthoimagery , 2008, GeoInformatica.

[36]  Derek T. Anderson,et al.  Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community , 2017 .

[37]  Michael Batty,et al.  Multifractal to monofractal evolution of the London street network. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Tomislav Lipic,et al.  Fine-tuning Convolutional Neural Networks for fine art classification , 2018, Expert Syst. Appl..

[39]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[41]  Bir Bhanu,et al.  Automatic Target Recognition: State of the Art Survey , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[42]  Craig A. Knoblock,et al.  Automatic extraction of road intersections from raster maps , 2005, GIS '05.

[43]  Thomas C. Henderson,et al.  Raster Map Image Analysis , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[44]  Lei Yang,et al.  An improved Sobel edge detection , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[46]  Mohammed Bennamoun,et al.  A Guide to Convolutional Neural Networks for Computer Vision , 2018, A Guide to Convolutional Neural Networks for Computer Vision.

[47]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[48]  Xi Zhou,et al.  Data augmentation for face recognition , 2017, Neurocomputing.

[49]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[51]  Toby P. Breckon,et al.  Using Deep Convolutional Neural Network Architectures for Object Classification and Detection Within X-Ray Baggage Security Imagery , 2018, IEEE Transactions on Information Forensics and Security.

[52]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[53]  Aria Pezeshk,et al.  Automatic Feature Extraction and Text Recognition From Scanned Topographic Maps , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Keiron O'Shea,et al.  An Introduction to Convolutional Neural Networks , 2015, ArXiv.

[55]  Abdesselam Bouzerdoum,et al.  Detecting People in Images: An Edge Density Approach , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[56]  Vladlen Koltun,et al.  Learning to propose objects , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Jae-Bok Song,et al.  Data augmentation using synthesized images for object detection , 2017, 2017 17th International Conference on Control, Automation and Systems (ICCAS).

[58]  Yoshimitsu Aoki,et al.  Disaster detection from aerial imagery with convolutional neural network , 2017, 2017 International Electronics Symposium on Knowledge Creation and Intelligent Computing (IES-KCIC).

[59]  Jennifer L. Walter,et al.  Standard for the U.S. Geological Survey Historical Topographic Map Collection , 2014 .

[60]  Ying Long,et al.  Redefining Chinese city system with emerging new data , 2016 .

[61]  Maryam Rahnemoonfar,et al.  Real-time yield estimation based on deep learning , 2017, Commercial + Scientific Sensing and Imaging.

[62]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[63]  C.-C. Jay Kuo,et al.  Boosted Convolutional Neural Networks (BCNN) for Pedestrian Detection , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[64]  Klemen Grm,et al.  Strengths and weaknesses of deep learning models for face recognition against image degradations , 2017, IET Biom..

[65]  Gowtham Atluri,et al.  A Machine Learning Framework for Accurate Functional Connectome Fingerprinting and an Application of a Siamese Network , 2019, CNI@MICCAI.

[66]  Seyed Majid Azimi,et al.  Road Segmentation in SAR Satellite Images With Deep Fully Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[67]  Arthur J. Helmicki,et al.  Vibration-based cable condition assessment: A novel application of neural networks , 2018, Engineering Structures.

[68]  Yao-Yi Chiang,et al.  SRC: a fully automatic geographic feature recognition system , 2018, SIGSPACIAL.

[69]  Craig A. Knoblock,et al.  Automatic and Accurate Extraction of Road Intersections from Raster Maps , 2008, GeoInformatica.

[70]  Huaizu Jiang,et al.  Face Detection with the Faster R-CNN , 2016, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[71]  Michael Batty,et al.  On the problem of boundaries and scaling for urban street networks , 2015, Journal of The Royal Society Interface.

[72]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[73]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[74]  Naomi Lynn Dickerson.  Refining Bounding-Box Regression for Object Localization , 2017 .

[75]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[76]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[77]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[78]  Hazim Kemal Ekenel,et al.  How Image Degradations Affect Deep CNN-Based Face Recognition? , 2016, 2016 International Conference of the Biometrics Special Interest Group (BIOSIG).

[79]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[80]  Michael Batty,et al.  Logistic Growth and Ergodic Properties of Urban Forms , 2015 .