Simplicity transformations for three-way arrays with symmetric slices, and applications to Tucker-3 models with sparse core arrays

Abstract Tucker three-way PCA and Candecomp/Parafac are two well-known methods of generalizing principal component analysis to three way data. Candecomp/Parafac yields component matrices A (e.g., for subjects or objects), B (e.g., for variables) and C (e.g., for occasions) that are typically unique up to jointly permuting and rescaling columns. Tucker-3 analysis, on the other hand, has full transformational freedom. That is, the fit does not change when A , B , and C are postmultiplied by nonsingular transformation matrices, provided that the inverse transformations are applied to the so-called core array G . This freedom of transformation can be used to create a simple structure in A , B , C , and/or in G . This paper deals with the latter possibility exclusively. It revolves around the question of how a core array, or, in fact, any three-way array can be transformed to have a maximum number of zero elements. Direct applications are in Tucker-3 analysis, where simplicity of the core may facilitate the interpretation of a Tucker-3 solution, and in constrained Tucker-3 analysis, where hypotheses involving sparse cores are taken into account. In the latter cases, it is important to know what degree of sparseness can be attained as a tautology, by using the transformational freedom. In addition, simplicity transformations have proven useful as a mathematical tool to examine rank and generic or typical rank of three-way arrays. So far, a number of simplicity results have been attained, pertaining to arrays sampled randomly from continuous distributions. These results do not apply to three-way arrays with symmetric slices in one direction. The present paper offers a number of simplicity results for arrays with symmetric slices of order 2 × 2 , 3 × 3 and 4 × 4 . Some generalizations to higher orders are also discussed. As a mathematical application, the problem of determining the typical rank of 4 × 3 × 3 and 5 × 3 × 3 arrays with symmetric slices will be revisited, using a sparse form with only 8 out of 36 elements nonzero for the former case and 10 out of 45 elements nonzero for the latter one, that can be attained almost surely for such arrays. The issue of maximal simplicity of the targets to be presented will be addressed, either by formal proofs or by relying on simulation results.

[1]  H. Kiers,et al.  Transforming three‐way arrays to multiple orthonormality , 2000 .

[2]  J. Berge,et al.  Transforming three-way arrays to maximal simplicity , 2002 .

[3]  Richard A. Harshman,et al.  Determination and Proof of Minimum Uniqueness Conditions for PARAFAC1 , 1972 .

[4]  J. Leeuw,et al.  Principal component analysis of three-mode data by means of alternating least squares algorithms , 1980 .

[5]  J. Berge,et al.  The typical rank of tall three-way arrays , 2000 .

[6]  F. Uhlig,et al.  A canonical form for a pair of real symmetric matrices that generate a nonsingular pencil , 1976 .

[7]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[8]  A. Agresti,et al.  Multiway Data Analysis , 1989 .

[9]  J. Kruskal Rank, decomposition, and uniqueness for 3-way and n -way arrays , 1989 .

[10]  J. Berge,et al.  Simplicity of core arrays in three-way principal component analysis and the typical rank of p×q×2 arrays , 1999 .

[11]  H. Kiers Three-way SIMPLIMAX for oblique rotation of the three-mode factor analysis core to simple structure , 1998 .

[12]  J. Berge,et al.  Typical rank and indscal dimensionality for symmetric three-way arrays of order I×2×2 or I×3×3 , 2004 .

[13]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[14]  H. Kiers TUCKALS core rotations and constrained TUCKALS modelling , 1992 .

[15]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[16]  J. Berge,et al.  A case of extreme simplicity of the core matrix in three-mode principal components analysis , 1998 .

[17]  Roberto Rocci,et al.  A simplification of a result by zellini on the maximal rank of symmetric three-way arrays , 1994 .

[18]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[19]  F. Fisher,et al.  The Identification Problem in Econometrics. , 1967 .