Projection Pursuit Indexes Based on Orthonormal Function Expansions

Abstract Projection pursuit describes a procedure for searching high-dimensional data for “interesting” low-dimensional projections via the optimization of a criterion function called the projection pursuit index. By empirically examining the optimization process for several projection pursuit indexes, we observed differences in the types of structure that maximized each index. We were especially curious about differences between two indexes based on expansions in terms of orthogonal polynomials, the Legendre index, and the Hermite index. Being fast to compute, these indexes are ideally suited for dynamic graphics implementations. Both Legendre and Hermite indexes are weighted L 2 distances between the density of the projected data and a standard normal density. A general form for this type of index is introduced that encompasses both indexes. The form clarifies the effects of the weight function on the index's sensitivity to differences from normality, highlighting some conceptual problems with the Legen...

[1]  On the Development of Arbitrary Functions in Series of Hermite's and Laguerre's Polynomials , 1926 .

[2]  D. Jackson Formal properties of orthogonal polynomials in two variables , 1936 .

[3]  Alexander A. Lubischew On the Use of Discriminant Functions in Taxonomy , 1962 .

[4]  Irene A. Stegun,et al.  Handbook of Mathematical Functions. , 1966 .

[5]  Donald Ervin Knuth,et al.  The Art of Computer Programming, Volume II: Seminumerical Algorithms , 1970 .

[6]  J. Kruskal TOWARD A PRACTICAL METHOD WHICH HELPS UNCOVER THE STRUCTURE OF A SET OF MULTIVARIATE OBSERVATIONS BY FINDING THE LINEAR TRANSFORMATION WHICH OPTIMIZES A NEW “INDEX OF CONDENSATION” , 1969 .

[7]  J. L. Warner,et al.  TRANSFORMATIONS OF MULTIVARIATE DATA , 1971 .

[8]  John W. Tukey,et al.  A Projection Pursuit Algorithm for Exploratory Data Analysis , 1974, IEEE Transactions on Computers.

[9]  Ramanathan Gnanadesikan,et al.  Methods for statistical data analysis of multivariate observations , 1977, A Wiley publication in applied statistics.

[10]  Ronald A. Thisted,et al.  Elements of statistical computing , 1986 .

[11]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[12]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[13]  J. Friedman Exploratory Projection Pursuit , 1987 .

[14]  Simon Morton,et al.  Interpretable projection pursuit , 1989 .

[15]  Jiayang Sun,et al.  Significance levels in exploratory projection pursuit , 1991 .