Near-Lossless Compression for Large Traffic Networks

With advancements in sensor technologies, intelligent transportation systems can collect traffic data with high spatial and temporal resolution. However, the size of the networks combined with the huge volume of the data puts serious constraints on system resources. Low-dimensional models can help ease these constraints by providing compressed representations for the networks. In this paper, we analyze the reconstruction efficiency of several low-dimensional models for large and diverse networks. The compression performed by low-dimensional models is lossy in nature. To address this issue, we propose a near-lossless compression method for traffic data by applying the principle of lossy plus residual coding. To this end, we first develop a low-dimensional model of the network. We then apply Huffman coding (HC) in the residual layer. The resultant algorithm guarantees that the maximum reconstruction error will remain below a desired tolerance limit. For analysis, we consider a large and heterogeneous test network comprising of more than 18 000 road segments. The results show that the proposed method can efficiently compress data obtained from a large and diverse road network, while maintaining the upper bound on the reconstruction error.

[1]  Michael G. Strintzis,et al.  Optimized transmission of JPEG2000 streams over wireless channels , 2006, IEEE Transactions on Image Processing.

[2]  Muhammad Tayyab Asif,et al.  Online map-matching based on Hidden Markov model for real-time traffic sensing applications , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[3]  Hojjat Adeli,et al.  Dynamic Wavelet Neural Network Model for Traffic Flow Forecasting , 2005 .

[4]  Yi Zhang,et al.  Simultaneously Prediction of Network Traffic Flow Based on PCA-SVR , 2007, ISNN.

[5]  Minglu Li,et al.  Compressive Sensing Approach to Urban Traffic Sensing , 2011, 2011 31st International Conference on Distributed Computing Systems.

[6]  Deborah Estrin,et al.  Using mobile phones to determine transportation modes , 2010, TOSN.

[7]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[8]  Alexandre M. Bayen,et al.  Estimating arterial traffic conditions using sparse probe data , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[9]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[10]  Jignesh M. Patel,et al.  Big data and its technical challenges , 2014, CACM.

[11]  Muhammad Tayyab Asif,et al.  Low-dimensional models for missing data imputation in road networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Li He,et al.  Data reduction in urban traffic sensor network , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[13]  Biswajit Basu,et al.  Real-Time Traffic Flow Forecasting Using Spectral Analysis , 2012, IEEE Transactions on Intelligent Transportation Systems.

[14]  Gunnar Flötteröd,et al.  Efficient real time OD matrix estimation based on Principal Component Analysis , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[15]  Jun Ding,et al.  A Method for Urban Traffic Data Compression Based on Wavelet-PCA , 2011, 2011 Fourth International Joint Conference on Computational Sciences and Optimization.

[16]  Zhang Yi,et al.  A Flow Volumes Data Compression Approach for Traffic Network Based on Principal Component Analysis , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[17]  Michael W. Berry,et al.  Algorithms and applications for approximate nonnegative matrix factorization , 2007, Comput. Stat. Data Anal..

[18]  Yang Xiao,et al.  The traffic data compression and decompression for intelligent traffic systems based on two-dimensional wavelet transformation , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[19]  Xavier Vilajosana,et al.  Bootstrapping smart cities through a self-sustainable model based on big data flows , 2013, IEEE Communications Magazine.

[20]  Steven T Parker,et al.  Large-Scale Intelligent Transportation System Traffic Detector Data Archiving , 2014 .

[21]  Danya Yao,et al.  A Survey of Traffic Control With Vehicular Communications , 2014, IEEE Transactions on Intelligent Transportation Systems.

[22]  Hao Liu,et al.  Incorporating Wavelet Decomposition Technique to Compress TransGuide Intelligent Transportation System Data , 2006 .

[23]  Miguel Elias M. Campista,et al.  COTraMS: A Collaborative and Opportunistic Traffic Monitoring System , 2014, IEEE Transactions on Intelligent Transportation Systems.

[24]  Fabien Moutarde,et al.  Spatial and temporal analysis of traffic states on large scale networks , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[25]  João Barros,et al.  A mobile sensing architecture for massive urban scanning , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[26]  Muhammad Tayyab Asif,et al.  Spatiotemporal Patterns in Large-Scale Traffic Speed Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[27]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[28]  Victoria Stodden,et al.  When Does Non-Negative Matrix Factorization Give a Correct Decomposition into Parts? , 2003, NIPS.

[29]  Yanru Zhang,et al.  A hybrid short-term traffic flow forecasting method based on spectral analysis and statistical volatility model , 2014 .

[30]  Alexandre M. Bayen,et al.  Large scale estimation of arterial traffic and structural analysis of traffic patterns using probe vehicles , 2012 .

[31]  Lin-lin Liang,et al.  A Data Compression Method for Traffic Loop Detectors' Signals Based on Lifting Wavelet Transformation and Entropy Coding , 2010, 2010 Third International Symposium on Information Science and Engineering.

[32]  Khalid Sayood,et al.  Introduction to Data Compression , 1996 .

[33]  Wanli Min,et al.  Real-time road traffic prediction with spatio-temporal correlations , 2011 .

[34]  Fengxiang Qiao,et al.  Intelligent Transportation Systems Data Compression Using Wavelet Decomposition Technique , 2009 .

[35]  Alexandre M. Bayen,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Learning the Dynamics of Arterial Traffic From Probe , 2022 .

[36]  Fabien Moutarde,et al.  Analysis of network-level traffic states using locality preservative non-negative matrix factorization , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[37]  Pravin Varaiya,et al.  Measuring Traffic , 2008, 0804.2982.

[38]  Kannan Srinivasan,et al.  Data compression techniques for urban traffic data , 2013, 2013 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS).

[39]  M. Ramasubba Reddy,et al.  Near-Lossless Multichannel EEG Compression Based on Matrix and Tensor Decompositions , 2013, IEEE Journal of Biomedical and Health Informatics.

[40]  Tamara Djukic,et al.  Application of Principal Component Analysis to Predict Dynamic Origin–Destination Matrices , 2012 .

[41]  M. Ramasubba Reddy,et al.  Multichannel EEG Compression: Wavelet-Based Image and Volumetric Coding Approach , 2013, IEEE Journal of Biomedical and Health Informatics.

[42]  Yi Zhang,et al.  PPCA-Based Missing Data Imputation for Traffic Flow Volume: A Systematical Approach , 2009, IEEE Transactions on Intelligent Transportation Systems.