Solving visual pollution with deep learning: A new nexus in environmental management.

Visual pollution is a relatively new concern amidst the existing plethora of mainstream environmental pollution, recommending the necessity for research to conceptualize, formalize, quantify and assess it from different dimensions. The purpose of this study is to create a new field of automated visual pollutant classification, harnessing the technological prowess of the 21st century for applications in environmental management. From the wide range of visual pollutants, four categories have been considered viz. (i) billboards and signage, (ii) telephone and communication wires, (iii) network and communication towers and (iv) street litter. The deep learning model used in this study simulates the human learning experience in the context of image recognition for visual pollutant classification by training and testing a convolutional neural network with several layers of artificial neurons. Data augmentation using image processing techniques and a train-test split ratio of 80:20 have been used. Training accuracy of 95% and validation accuracy of 85% have been achieved by the deep learning model. The results indicate that the upper limit of accuracy i.e. the asymptote, depends on the dataset size for this type of task. This study has several applications in environmental management. For example, the deployment of the trained model for processing of video/live footage from smartphone applications, closed-circuit television and drones/unmanned aerial vehicles can be applied for both the removal and management of visual pollutants in the natural and built environment. Furthermore, generating the 'visual pollution score/index' of urban regions such as towns and cities will create a new 'metric/indicator' in the field of urban environmental management.

[1]  Michael L. Hines,et al.  NeuroML: A Language for Describing Data Driven Models of Neurons and Networks with a High Degree of Biological Detail , 2010, PLoS Comput. Biol..

[2]  Marc Chaumont,et al.  A Deep learning method for accurate and fast identification of coral reef fishes in underwater images , 2018, Ecol. Informatics.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Gordon Cullen The Concise Townscape , 1971 .

[5]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[6]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[7]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[8]  R. Douglas,et al.  A silicon neuron , 1991, Nature.

[9]  Joseph P. Zbilut,et al.  A model of biological neuron with terminal chaos and quantum-like features , 2006 .

[10]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[11]  R. Schaller,et al.  Moore's law: past, present and future , 1997 .

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[14]  Romedi Passini,et al.  Wayfinding: People, Signs, and Architecture , 1992 .

[15]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[16]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Yoshinobu Ashihara The Aesthetic Townscape , 1983 .

[18]  A. Prinz,et al.  Phase resetting and phase locking in hybrid circuits of one model and one biological neuron. , 2004, Biophysical journal.

[19]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[20]  Devis Tuia,et al.  Detecting Mammals in UAV Images: Best Practices to address a substantially Imbalanced Dataset with Deep Learning , 2018, Remote Sensing of Environment.

[21]  Bogdan Zagajewski,et al.  Citizen science and WebGIS for outdoor advertisement visual pollution assessment , 2018, Comput. Environ. Urban Syst..

[22]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Sang Michael Xie,et al.  Combining satellite imagery and machine learning to predict poverty , 2016, Science.

[24]  Michele Volpi,et al.  Detecting animals in African Savanna with UAVs and the crowds , 2017, ArXiv.

[25]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[26]  In the Context of Visual Pollution: Effects to Trabzon City Center Silhoutte , 2011 .

[27]  Guido Rossum,et al.  Python Reference Manual , 2000 .

[28]  Milan Jana,et al.  VISUAL POLLUTION CAN HAVE A DEEP DEGRADING EFFECT ON URBAN AND SUBURBAN COMMUNITY: A STUDY IN FEW PLACES OF BENGAL, INDIA, WITH SPECIAL REFERENCE TO UNORGANIZED BILLBOARDS , 2015 .

[29]  Sumartono Sumartono Visual Pollution in the Context of Conflicting Design Requirements , 2009 .

[30]  E. Marder,et al.  Multiple models to capture the variability in biological neurons and networks , 2011, Nature Neuroscience.

[31]  Piotr Tompalski,et al.  Measuring visual pollution by outdoor advertisements in an urban street using intervisibilty analysis and public surveys , 2016, Int. J. Geogr. Inf. Sci..

[32]  E. Abbasi,et al.  Factors Affecting the Aesthetic Behavior of Villagers towards the Natural Environment: The Case of Kermanshah Province, Iran , 2018 .

[33]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[34]  Cathrine Ulla Jensen,et al.  The Vindication of Don Quixote: The Impact of Noise and Visual Pollution from Wind Turbines , 2014, Land Economics.