RiskSens: A Multi-view Learning Approach to Identifying Risky Traffic Locations in Intelligent Transportation Systems Using Social and Remote Sensing

With the ever-increasing number of road traffic accidents worldwide, the road traffic safety has become a critical problem in intelligent transportation systems. A key step towards improving the road traffic safety is to identify the locations where severe traffic accidents happen with a high probability so the precautions can be applied effectively. We refer to this problem as risky traffic location identification. While previous efforts have been made to address similar problems, two important limitations exist: i) data availability: many cities (especially in developing countries) do not maintain a publicly accessible database for the traffic accident records in a city, which makes it difficult to accurately estimate the accidents in the city; ii) location accuracy: many self-reported traffic accidents (e.g., social media posts from common citizens) are not associated with the exact GPS locations due to the privacy concerns. To address these limitations, this paper develops the RiskSens, a multi-view learning approach to identifying the risky traffic locations in a city by jointly exploring the social and remote sensing data. We evaluate RiskSens using a real world dataset from New York. The evaluation results show that RiskSens significantly outperforms the state-of-the- art baselines in identifying risky traffic locations in a city.

[1]  Kuan-Ting Yu,et al.  Multi-view self-supervised deep learning for 6D pose estimation in the Amazon Picking Challenge , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Xiaobo Sharon Hu,et al.  A Real-Time and Non-Cooperative Task Allocation Framework for Social Sensing Applications in Edge Computing Systems , 2018, 2018 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS).

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[5]  Charu C. Aggarwal,et al.  Using humans as sensors: An estimation-theoretic perspective , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[6]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[7]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Marie Lachaise,et al.  Traffic monitoring with serial images from airborne cameras , 2006 .

[10]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[11]  Xiaoling Chen,et al.  Remote sensing image-based analysis of the relationship between urban heat island and land use/cover changes , 2006 .

[12]  Matti Pietikäinen,et al.  Local Binary Patterns , 2010, Scholarpedia.

[13]  Weisheng Wang,et al.  A Study for Texture Feature Extraction of High-Resolution Satellite Images Based on a Direction Measure and Gray Level Co-Occurrence Matrix Fusion Algorithm , 2017, Sensors.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Dong Wang,et al.  On Scalable and Robust Truth Discovery in Big Data Social Media Sensing Applications , 2019, IEEE Transactions on Big Data.

[16]  Thierry Delot,et al.  Collaborative Sensing for Urban Transportation , 2014, IEEE Data Eng. Bull..

[17]  Cyrus Shahabi,et al.  Crowd sensing of traffic anomalies based on human mobility and social media , 2013, SIGSPATIAL/GIS.

[18]  Frederick H. Lochovsky,et al.  Data extraction and label assignment for web databases , 2003, WWW '03.

[19]  Douglas Thain,et al.  Towards Scalable and Dynamic Social Sensing Using A Distributed Computing Framework , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[20]  Alfred O. Hero,et al.  Semi-Supervised Learning via Sparse Label Propagation , 2016 .

[21]  D. Mulla Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps , 2013 .

[22]  Charu C. Aggarwal,et al.  Recursive Fact-Finding: A Streaming Approach to Truth Estimation in Crowdsourcing Applications , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems.

[23]  Sinisa Segvic,et al.  Classifying Traffic Scenes Using The GIST Image Descriptor , 2013, ArXiv.

[24]  Dong Wang,et al.  Social Sensing: Building Reliable Systems on Unreliable Data , 2015 .

[25]  Giuseppe Anastasi,et al.  Urban and social sensing for sustainable mobility in smart cities , 2013, 2013 Sustainable Internet and ICT for Sustainability (SustainIT).

[26]  Rungang Han,et al.  On robust truth discovery in sparse social media sensing , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[27]  Yuan-Chih Yu A mobile social networking service for urban community disaster response , 2015, Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015).

[28]  Masaru Kitsuregawa,et al.  Visual fusion of mega-city big data: An application to traffic and tweets data analysis of Metro passengers , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[29]  Xuan Liu,et al.  Multi-view Response Selection for Human-Computer Conversation , 2016, EMNLP.

[30]  Dong-Hyun Lee,et al.  Pseudo-Label : The Simple and Efficient Semi-Supervised Learning Method for Deep Neural Networks , 2013 .

[31]  Heng Ji,et al.  The Age of Social Sensing , 2018, Computer.

[32]  Christopher De Sa,et al.  Data Programming: Creating Large Training Sets, Quickly , 2016, NIPS.

[33]  Shun'ichi Kaneko,et al.  Combining Satellite Imagery and Open Data to Map Road Safety , 2017, AAAI.

[34]  Xuan Song,et al.  Learning Deep Representation from Big and Heterogeneous Data for Traffic Accident Inference , 2016, AAAI.

[35]  Feng Chen,et al.  From Twitter to detector: real-time traffic incident detection using social media data , 2016 .

[36]  Jadunandan Dash,et al.  Recent advances in space-borne optical remote sensing systems for monitoring global terrestrial ecosystems , 2016 .

[37]  Nada Lavrač,et al.  Towards Multiview Approach to Parkinson ’ s Disease Quality of Life Data Analysis , 2016 .

[38]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[39]  Richard Andrášik,et al.  Identification of hazardous road locations of traffic accidents by means of kernel density estimation and cluster significance evaluation. , 2013, Accident; analysis and prevention.

[40]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).