On Revealing Replicating Structures in Multiway Data: A Novel Tensor Decomposition Approach

A novel tensor decomposition is proposed to make it possible to identify replicating structures in complex data, such as textures and patterns in music spectrograms. In order to establish a computational framework for this paradigm, we adopt a multiway (tensor) approach. To this end, a novel tensor product is introduced, and the subsequent analysis of its properties shows a perfect match to the task of identification of recurrent structures present in the data. Out of a whole class of possible algorithms, we illuminate those derived so as to cater for orthogonal and nonnegative patterns. Simulations on texture images and a complex music sequence confirm the benefits of the proposed model and of the associated learning algorithms.

[1]  Abderrahman Bouhamidi,et al.  A Kronecker approximation with a convex constrained optimization method for blind image restoration , 2012, Optim. Lett..

[2]  C. Loan,et al.  Approximation with Kronecker Products , 1992 .

[3]  Misha Elena Kilmer,et al.  Kronecker product approximation for preconditioning in three-dimensional imaging applications , 2006, IEEE Transactions on Image Processing.

[4]  Judith M. Ford,et al.  Combining Kronecker Product Approximation with Discrete Wavelet Transforms to Solve Dense, Function-Related Linear Systems , 2003, SIAM J. Sci. Comput..

[5]  Andrzej Cichocki,et al.  Low-rank blind nonnegative matrix deconvolution , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part I: Lemmas for Partitioned Matrices , 2008, SIAM J. Matrix Anal. Appl..

[7]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[8]  Peter Ladefoged,et al.  UCLA Working Papers in Phonetics, 23. , 1972 .

[9]  Boris N. Khoromskij,et al.  Hierarchical Kronecker tensor-product approximations , 2005, J. Num. Math..

[10]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[11]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[12]  Tamara G. Kolda,et al.  Categories and Subject Descriptors: G.4 [Mathematics of Computing]: Mathematical Software— , 2022 .