Hierarchical third‐order tensor decomposition through inverse difference pyramid based on the three‐dimensional Walsh–Hadamard transform with applications in data mining

A new approach is presented for hierarchical decomposition of third‐order tensors through their transformation into the generalized three‐dimensional (3D) spectrum space based on the inverse difference pyramid (IDP). For this, we choose the 3D Walsh–Hadamard transform (3D‐WHT). As result, each tensor is represented as a spectral tensor of m hierarchical levels which contains selected low‐frequency 3D‐WHT coefficients. Calculating sequentially the inverse 3D‐WHT for the coefficients from each pyramid level starting from its top, the tensor is approximated with increasing accuracy until its full restoration is achieved. To illustrate the new approach, given is the algorithm for hierarchical three‐level tensor decomposition based on the reduced IDP. The proposed approach permits simultaneous decorrelation of tensor elements in three mutually orthogonal directions. The energy of the tensor elements is concentrated in a small number of spectral coefficients which build the top of the inverse pyramid. The use of the 3D‐WHT permits to achieve minimum computational complexity, compared to deterministic 3D orthogonal transforms. The main applications of the new method for data mining in the contemporary intelligent systems are in the processing and analysis of large sets of different kinds of data/images/videos in the following areas: Compression of correlated image sequences, computer tomography, thermo vision, ultrasound and multichannel medical signals; search of 3D objects in image databases; extraction of features for recognition of 3D objects; multidimensional data denoising; multilayer watermarking of video sequences; and so on.

[1]  K. Held,et al.  Raman-scattering measurements and theory of the energy-momentum spectrum for underdoped Bi2Sr2CaCuO(8+δ) superconductors: evidence of an s-wave structure for the pseudogap. , 2013, Physical review letters.

[2]  Theresa Beaubouef,et al.  Rough set spatial data modeling for data mining , 2004, Int. J. Intell. Syst..

[3]  Vladimir Jotsov,et al.  Applications in intelligent systems of knowledge discovery methods based on human–machine interaction , 2008 .

[4]  Erik G. Larsson,et al.  Lecture Notes: Floating-Point Numbers , 2010 .

[5]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[6]  Selin Aviyente,et al.  A multiscale approach for tensor denoising , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[7]  Qiuqi Ruan,et al.  A Novel 3D Facial Expression Recognition Approach Based on Tensor Distance , 2018, 2018 2nd IEEE Advanced Information Management,Communicates,Electronic and Automation Control Conference (IMCEC).

[8]  Xiaodong Wang,et al.  Fourth-order Tensors with Multidimensional Discrete Transforms , 2017, ArXiv.

[9]  Patrick Dupont,et al.  Tensor decompositions and data fusion in epileptic electroencephalography and functional magnetic resonance imaging data , 2017, WIREs Data Mining Knowl. Discov..

[10]  Rashmi.  Data Mining: A Knowledge Discovery Approach , 2012 .

[11]  Byung Cheol Song,et al.  Clustering-Based Image Retrieval Using Fast Exhaustive Multi-resolution Search Algorithm , 2004, PCM.

[12]  Witold Pedrycz,et al.  Associations and rules in data mining: A link analysis , 2004, Int. J. Intell. Syst..

[13]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[14]  Stuart Harvey Rubin,et al.  Content Based Image Retrieval Using Adaptive Inverse Pyramid Representation , 2009, HCI.

[15]  Xiaohua Hu,et al.  A data warehouse/online analytic processing framework for web usage mining and business intelligence reporting , 2004, Int. J. Intell. Syst..

[16]  Selin Aviyente,et al.  Multiscale tensor decomposition , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[17]  A-Xing Zhu,et al.  A Hierarchical Tensor-Based Approach to Compressing, Updating and Querying Geospatial Data , 2015, IEEE Transactions on Knowledge and Data Engineering.

[18]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Show-Jane Yen.  Mining interesting sequential patterns for intelligent systems , 2005, Int. J. Intell. Syst..

[20]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[21]  Ivan V. Oseledets,et al.  Tensor methods and recommender systems , 2016, Wiley Interdiscip. Rev. Data Min. Knowl. Discov..

[22]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[23]  N. Krüger,et al.  First-order and second-order statistical analysis of 3d and 2d image structure , 2007, Network.

[24]  David Picard,et al.  Compact tensor based image representation for similarity search , 2012, 2012 19th IEEE International Conference on Image Processing.

[25]  Witold Pedrycz,et al.  Data Mining: A Knowledge Discovery Approach , 2007 .

[26]  Stephan Günnemann,et al.  Introduction to Tensor Decompositions and their Applications in Machine Learning , 2017, ArXiv.

[27]  Roumen Kountchev,et al.  Image Representation with Reduced Spectrum Pyramid , 2008, New Directions in Intelligent Interactive Multimedia.

[28]  Jianqiang Li,et al.  Diversity of Sweepoviruses Infecting Sweet Potato in China. , 2017, Plant disease.

[29]  Andrzej Cichocki,et al.  Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 1 Low-Rank Tensor Decompositions , 2016, Found. Trends Mach. Learn..

[30]  Abraham Kandel,et al.  Using data mining techniques for optimizing traffic signal plans at an urban intersection , 2011, Int. J. Intell. Syst..

[31]  S. Agaian.  Hadamard Matrices and Their Applications , 1985 .

[32]  Vipin Tyagi,et al.  Content-Based Image Retrieval , 2017, Springer Singapore.

[33]  Nikos D. Sidiropoulos,et al.  Tensor Decomposition for Signal Processing and Machine Learning , 2016, IEEE Transactions on Signal Processing.

[34]  Morten Mørup,et al.  Applications of tensor (multiway array) factorizations and decompositions in data mining , 2011, WIREs Data Mining Knowl. Discov..