Traffic flow data compression considering burst components

Many recent applications of intelligent transportation systems require both real-time and network-wide traffic flow data as input. However, as the detection time and network size increase, the data volume may become very large in terms of both dimension and scale. To address this concern, various traffic flow data compression methods have been proposed, which archive the low-dimensional subspace rather than the original data. Many studies have shown the traffic flow data consist of different components, i.e. low-dimensional intra-day trend, Gaussian type fluctuation and burst components. Existing compression methods cannot compress the burst components well and provide very limited choices of compression ratio (CR). A better compression method should have the ability to archive all the dominant information in different components of traffic flow data. In this study, the authors compare the influence of different data reformatting, archive the bursts defined before in descending order with respect to the absolute value of the burst points and propose a flexible compression framework to balance between burst components and low-dimensional intra-day trend. Experimental results show that the proposed framework promotes the reconstruction accuracy significantly. Moreover, the proposed framework provides more flexible choices with respect to CR, which can benefit a variety of applications.

[1]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[2]  Kannan Srinivasan,et al.  Data compression techniques for urban traffic data , 2013, 2013 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS).

[3]  Zhang Yi,et al.  A Flow Volumes Data Compression Approach for Traffic Network Based on Principal Component Analysis , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[4]  W. Steeb,et al.  Matrix Calculus and Kronecker Product: A Practical Approach to Linear and Multilinear Algebra , 2011 .

[5]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[6]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[7]  Yi Zhang,et al.  Trend Modeling for Traffic Time Series Analysis: An Integrated Study , 2015, IEEE Transactions on Intelligent Transportation Systems.

[8]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[9]  Yang Xiao,et al.  The traffic data compression and decompression for intelligent traffic systems based on two-dimensional wavelet transformation , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[10]  Li Li,et al.  Robust causal dependence mining in big data network and its application to traffic flow predictions , 2015 .

[11]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[12]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[13]  Guillaume Leduc,et al.  Road Traffic Data: Collection Methods and Applications , 2008 .

[15]  Jianming Hu,et al.  FLUCTUATIONS IN URBAN TRAFFIC NETWORKS , 2008 .

[16]  Yi Zhang,et al.  A Mixed-Fractal Traffic Flow Model Whose Hurst Exponent Appears Crossover , 2012, 2012 Fifth International Joint Conference on Computational Sciences and Optimization.

[17]  Zhiyong Cui,et al.  Real-Time Bidirectional Traffic Flow Parameter Estimation From Aerial Videos , 2017, IEEE Transactions on Intelligent Transportation Systems.

[18]  John Shawe-Taylor,et al.  Data mining, data fusion and information management , 2006 .

[19]  Mehdi Ghatee,et al.  A Rule-Based Decision Support System in Intelligent Hazmat Transportation System , 2015, IEEE Transactions on Intelligent Transportation Systems.

[20]  Jun Ding,et al.  A Method for Urban Traffic Data Compression Based on Wavelet-PCA , 2011, 2011 Fourth International Joint Conference on Computational Sciences and Optimization.

[21]  Mehdi Ghatee,et al.  An inference engine for smartphones to preprocess data and detect stationary and transportation modes , 2016 .

[22]  Yin Wang,et al.  The retrieval of intra-day trend and its influence on traffic prediction , 2012 .