Structure preserving dimension reduction with 2D images as predictors

Nearly all existing dimension reduction methods on 2D matrix-valued image predictors are unsupervised or supervised without preserving matrix structure, which can result in loss of the structure-specific relation between the response and predictors. In this paper, we propose a kernel-based solution for supervised dimension reduction which preserves the matrix structure of the reduced predictors. This approach is computationally efficient and offers a unified framework to handle image predictors. We illustrate the method using both simulations and applications.

[1]  R. H. Moore,et al.  Regression Graphics: Ideas for Studying Regressions Through Graphics , 1998, Technometrics.

[2]  Bing Li,et al.  Principal support vector machines for linear and nonlinear sufficient dimension reduction , 2011, 1203.2790.

[3]  N. Altman,et al.  On dimension folding of matrix- or array-valued statistical objects , 2010, 1002.4789.

[4]  Lexin Li,et al.  Biological pathway selection through nonlinear dimension reduction. , 2011, Biostatistics.

[5]  Michael I. Jordan,et al.  Dimensionality Reduction for Supervised Learning with Reproducing Kernel Hilbert Spaces , 2004, J. Mach. Learn. Res..

[6]  H. Zha,et al.  Contour regression: A general approach to dimension reduction , 2005, math/0508277.

[7]  Ker-Chau Li,et al.  On Principal Hessian Directions for Data Visualization and Dimension Reduction: Another Application of Stein's Lemma , 1992 .

[8]  Y. Xia A constructive approach to the estimation of dimension reduction directions , 2007, math/0701761.

[9]  Yingcun Xia,et al.  Sliced Regression for Dimension Reduction , 2008 .

[10]  Sayan Mukherjee,et al.  Localized Sliced Inverse Regression , 2008, NIPS.

[11]  H. Tong,et al.  Article: 2 , 2002, European Financial Services Law.

[12]  S. Weisberg,et al.  Comments on "Sliced inverse regression for dimension reduction" by K. C. Li , 1991 .

[13]  Shaoli Wang,et al.  On Directional Regression for Dimension Reduction , 2007 .

[14]  Ker-Chau Li,et al.  Sliced Inverse Regression for Dimension Reduction , 1991 .

[15]  Michael I. Jordan,et al.  Kernel dimension reduction in regression , 2009, 0908.1854.