Matrix and Tensor Completion in Multiway Delay Embedded Space Using Tensor Train, With Application to Signal Reconstruction

In this paper, the problem of time series reconstruction in a multiway delay embedded space using Tensor Train decomposition is addressed. A new algorithm has been developed in which an incomplete signal is first transformed to a Hankel matrix and in the next step to a higher order tensor using extended Multiway Delay embedded Transform. Then, the resulting higher order tensor is completed using low rank Tensor Train decomposition. Comparing to previous Hankelization approaches, in the proposed approach, blocks of elements are used for Hankelization instead of individual elements, which results in producing a higher order tensor. Simulation results confirm the effectiveness and high performance of the proposed completion approach. Although in this paper we focus on single time series, our method can be straightforwardly extended to reconstruction of multivariate time series, color images and videos.

[1]  Dimitrios D. Thomakos,et al.  A review on singular spectrum analysis for economic and financial time series , 2010 .

[2]  Lars Grasedyck,et al.  Variants of Alternating Least Squares Tensor Completion in the Tensor Train Format , 2015, SIAM J. Sci. Comput..

[3]  Andrzej Cichocki,et al.  Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 1 Low-Rank Tensor Decompositions , 2016, Found. Trends Mach. Learn..

[4]  Felix J. Herrmann,et al.  Low-rank Promoting Transformations and Tensor Interpolation - Applications to Seismic Data Denoising , 2014 .

[5]  Marko Filipovic,et al.  Tucker factorization with missing data with application to low-$$n$$n-rank tensor completion , 2015, Multidimens. Syst. Signal Process..

[6]  Ce Zhu,et al.  Image Completion Using Low Tensor Tree Rank and Total Variation Minimization , 2019, IEEE Transactions on Multimedia.

[7]  Masashi Sugiyama,et al.  Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 2 Applications and Future Perspectives , 2017, Found. Trends Mach. Learn..

[8]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations for Incomplete Data , 2010, ArXiv.

[9]  Steven L. Brunton,et al.  Chaos as an intermittently forced linear system , 2016, Nature Communications.

[10]  S. Sanei,et al.  Tensor Based Singular Spectrum Analysis for Automatic Scoring of Sleep EEG , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Enrico Zio,et al.  Singular Spectrum Analysis for Forecasting of Electric Load Demand , 2013 .

[12]  Lei Chen,et al.  Block Hankel Tensor ARIMA for Multiple Short Time Series Forecasting , 2020, AAAI.

[13]  Shuchin Aeron,et al.  5D seismic data completion and denoising using a novel class of tensor decompositions , 2015 .

[14]  Ivan Oseledets,et al.  Tensor-Train Decomposition , 2011, SIAM J. Sci. Comput..

[15]  Devavrat Shah,et al.  Model Agnostic Time Series Analysis via Matrix Estimation , 2018, Proc. ACM Meas. Anal. Comput. Syst..

[16]  Hidekata Hontani,et al.  Missing Slice Recovery for Tensors Using a Low-Rank Model in Embedded Space , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Jianting Cao,et al.  High-order tensor completion via gradient-based optimization under tensor train format , 2019, Signal Process. Image Commun..

[18]  Hidekata Hontani,et al.  Tensor Completion with Shift-invariant Cosine Bases , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[19]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Minh N. Do,et al.  Efficient Tensor Completion for Color Image and Video Recovery: Low-Rank Tensor Train , 2016, IEEE Transactions on Image Processing.

[21]  Nikos D. Sidiropoulos,et al.  Batch and Adaptive PARAFAC-Based Blind Separation of Convolutive Speech Mixtures , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[22]  Andrzej Cichocki,et al.  Era of Big Data Processing: A New Approach via Tensor Networks and Tensor Decompositions , 2014, ArXiv.

[23]  Lynn Burroughs,et al.  Interpolation Using Hankel Tensor Completion , 2013 .

[24]  Yifan Sun,et al.  Wide Compression: Tensor Ring Nets , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[26]  Ngai Wong,et al.  Fast and Accurate Tensor Completion with Tensor Trains: A System Identification Approach , 2018, ArXiv.

[27]  Hossein Hassani,et al.  An improved SSA forecasting result based on a filtered recurrent forecasting algorithm , 2017 .