Urban Street Cleanliness Assessment Using Mobile Edge Computing and Deep Learning

During the process of smart city construction, city managers always spend a lot of energy and money for cleaning street garbage due to the random appearances of street garbage. Consequently, visual street cleanliness assessment is particularly important. However, the existing assessment approaches have some clear disadvantages, such as the collection of street garbage information is not automated and street cleanliness information is not real-time. To address these disadvantages, this paper proposes a novel urban street cleanliness assessment approach using mobile edge computing and deep learning. First, the high-resolution cameras installed on vehicles collect the street images. Mobile edge servers are used to store and extract street image information temporarily. Second, these processed street data is transmitted to the cloud data center for analysis through city networks. At the same time, Faster Region-Convolutional Neural Network (Faster R-CNN) is used to identify the street garbage categories and count the number of garbage. Finally, the results are incorporated into the street cleanliness calculation framework to ultimately visualize the street cleanliness levels, which provides convenience for city managers to arrange clean-up personnel effectively. The overall approach is illustrated and visualized using the street images of Jiangning District in Nanjing, China. The practical application shows the feasibility and usability of the approach.

[1]  Pierfrancesco Bellini,et al.  Analysis and assessment of a knowledge based smart city architecture providing service APIs , 2017, Future Gener. Comput. Syst..

[2]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[3]  Anna Corinna Cagliano,et al.  Current trends in Smart City initiatives: some stylised facts , 2014 .

[4]  Annalisa Cocchia Smart and Digital City: A Systematic Literature Review , 2014 .

[5]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[6]  Diego López-de-Ipiña,et al.  Citizen-centric data services for smarter cities , 2017, Future Gener. Comput. Syst..

[7]  Magdalini Eirinaki,et al.  A Deep Learning Framework for Smart Street Cleaning , 2017, 2017 IEEE Third International Conference on Big Data Computing Service and Applications (BigDataService).

[8]  Verónica Gutiérrez,et al.  Developing an indicators plan and software for evaluating Street Cleanliness and Waste Collection Services , 2017 .

[9]  Abdelaziz Bouras,et al.  Integration of Smart City and Lifecycle Concepts for Enhanced Large-Scale Event Management , 2015, PLM.

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Nor Badrul Anuar,et al.  The role of big data in smart city , 2016, Int. J. Inf. Manag..

[12]  B. L. Juan Carlos,et al.  Automatic Waste Classification using Computer Vision as an Application in Colombian High Schools , 2015 .

[13]  Jean-Philippe Thiran,et al.  A Computer Vision System to Localize and Classify Wastes on the Streets , 2017, ICVS.

[14]  Andrei Borozdukhin,et al.  Approach to the garbage collection in the “Smart Clean City” project , 2016, 2016 4th IEEE International Colloquium on Information Science and Technology (CiSt).

[15]  Bharat Bhushan,et al.  A Mutilple-Level Assessment System for Smart City Street Cleanliness , 2018, SEKE.

[16]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  R. Hollands Will the real smart city please stand up? , 2008, The Routledge Companion to Smart Cities.

[18]  Sghaier Guizani,et al.  Mobile ad hoc cloud: A survey , 2016, Wirel. Commun. Mob. Comput..

[19]  Brajesh Dubey,et al.  Characterization of pollutants in Florida street sweepings for management and reuse. , 2009, Journal of environmental management.

[20]  A. While,et al.  Competitive urbanism and the limits to smart city innovation: The UK Future Cities initiative , 2017 .

[21]  G. G. Ryzin,et al.  Measuring Street Cleanliness: A Comparison of New York City’s Scorecard and Results from a Citizen Survey , 2008 .

[22]  Gaurav Mittal,et al.  SpotGarbage: smartphone app to detect garbage using deep learning , 2016, UbiComp.

[23]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[26]  R. Kitchin The real-time city? Big data and smart urbanism , 2013 .

[27]  Felix Wortmann,et al.  Internet of Things , 2015, Business & Information Systems Engineering.