Image Classification to Determine the Level of Street Cleanliness: A Case Study

The street cleanliness of big cities has a high impact on urban environment and health, so cities invest lots of effort to make their streets clean. With the recent advances in technology, it is feasible to develop smart systems for monitoring street cleanliness at scale such as automatic classification of street images to identify the cleanliness level by utilizing conventional classifiers (e.g., Naive Bayes and AdaBoost). However, these baseline methods do not provide a desired classification accuracy in practice. Thus, we propose a geo-spatial classification approach to enhance the classification accuracy. In particular, since the crowdsourced images are tagged with geo-location (i.e., GPS coordinates), we devise a novel framework with multiple local trained models exploiting the similarity of local images so that the proposed models learn better street image classification for each geographical region. This paper also presents a case study of street cleanliness classification using a large real-world geo-tagged image dataset obtained from Los Angeles Sanitation Department (LASAN). Experimental results showed that our framework was able to achieve an F1 score of around 0.9.

[1]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[2]  Cyrus Shahabi,et al.  Geo-Spatial Multimedia Sentiment Analysis in Disasters , 2017, 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[3]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Cyrus Shahabi,et al.  Hybrid Indexes for Spatial-Visual Search , 2017, ACM Multimedia.

[5]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[6]  Ni-Bin Chang,et al.  Soil erosion and non-point source pollution impacts assessment with the aid of multi-temporal remote sensing images. , 2006, Journal of environmental management.

[7]  E-Liang Chen,et al.  An automatic diagnostic system for CT liver image classification , 1998, IEEE Transactions on Biomedical Engineering.

[8]  Hanan Samet,et al.  Foundations of multidimensional and metric data structures , 2006, Morgan Kaufmann series in data management systems.

[9]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[10]  M A Hannan,et al.  Feature extraction using Hough transform for solid waste bin level detection and classification , 2014, Environmental Monitoring and Assessment.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  J. Copas Binary Regression Models for Contaminated Data , 1988 .

[13]  Ramesh Raskar,et al.  Streetscore -- Predicting the Perceived Safety of One Million Streetscapes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Kanchan Mahajan,et al.  Waste Bin Monitoring System UsingIntegrated Technologies , 2014 .

[15]  Jerry Zeyu Gao,et al.  An edge-based smart mobile service system for illegal dumping detection and monitoring in San Jose , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[16]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[18]  Cyrus Shahabi,et al.  Scalable Spatial Crowdsourcing: A Study of Distributed Algorithms , 2015, 2015 16th IEEE International Conference on Mobile Data Management.

[19]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Cyrus Shahabi,et al.  GeoCrowd: enabling query answering with spatial crowdsourcing , 2012, SIGSPATIAL/GIS.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.