CUR decomposition for compression and compressed sensing of large-scale traffic data

Intelligent Transportation Systems (ITS) often operate on large road networks, and typically collect traffic data with high temporal resolution. Consequently, ITS need to handle massive volumes of data, and methods to represent that data in more compact representations are sorely needed. Subspace methods such as Principal Component Analysis (PCA) can create accurate low-dimensional models. However, such models are not readily interpretable, as the principal components usually involve a large number of links in the traffic network. In contrast, the CUR matrix decomposition leads to low-dimensional models where the components correspond to individual links in the network; the resulting models can be easily interpreted, and can also be used for compressed sensing of the traffic network. In this paper, the CUR matrix decomposition is applied for two purposes: (1) compression of traffic data; (2) compressed sensing of traffic data. In the former, only data from a “random” subset of links and time instances is stored. In the latter, data for the entire traffic network is inferred from measurements at a “random” subset of links. Numerical results for a large traffic network in Singapore demonstrate the feasibility of the proposed approach.

[1]  Jimeng Sun,et al.  Less is More: Compact Matrix Decomposition for Large Sparse Graphs , 2007, SDM.

[2]  Fabien Moutarde,et al.  Analysis of network-level traffic states using locality preservative non-negative matrix factorization , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[3]  Gunnar Flötteröd,et al.  Efficient real time OD matrix estimation based on Principal Component Analysis , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[4]  Yi Zhang,et al.  Simultaneously Prediction of Network Traffic Flow Based on PCA-SVR , 2007, ISNN.

[5]  Yang Liu,et al.  High Dimensionality Reduction Using CUR Matrix Decomposition and Auto-encoder for Web Image Classification , 2010, PCM.

[6]  S. Muthukrishnan,et al.  Relative-Error CUR Matrix Decompositions , 2007, SIAM J. Matrix Anal. Appl..

[7]  Shusen Wang,et al.  A Scalable CUR Matrix Decomposition Algorithm: Lower Time Complexity and Tighter Bound , 2012, NIPS.

[8]  M. Ramasubba Reddy,et al.  Multi-channel EEG compression based on matrix and tensor decompositions , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Gene H. Golub,et al.  Calculating the singular values and pseudo-inverse of a matrix , 2007, Milestones in Matrix Computation.

[10]  Sejoon Lim,et al.  City-scale traffic estimation from a roving sensor network , 2012, SenSys '12.

[11]  Kannan Srinivasan,et al.  Data compression techniques for urban traffic data , 2013, 2013 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS).

[12]  Tamara Djukic,et al.  Application of Principal Component Analysis to Predict Dynamic Origin–Destination Matrices , 2012 .

[13]  Zhang Yi,et al.  A Flow Volumes Data Compression Approach for Traffic Network Based on Principal Component Analysis , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[14]  B. AfeArd CALCULATING THE SINGULAR VALUES AND PSEUDOINVERSE OF A MATRIX , 2022 .

[15]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[16]  Petros Drineas,et al.  CUR matrix decompositions for improved data analysis , 2009, Proceedings of the National Academy of Sciences.