Bayesian logistic regression with sparse general representation prior for multispectral image classification

In this work we address the multispectral image classification problem from a Bayesian perspective. We develop an algorithm which utilizes the logistic regression function as the observation model in a probabilistic framework, Super-Gaussian (SG) priors which promote sparsity on the adaptive coefficients, and Variational inference to obtain estimates of all the model unknowns. The proposed algorithm is validated on both synthetic and real experiments and compared with other state-of-the-art methods, such as Support Vector Machine and Gaussian Processes, demonstrating its improved performance.

[1]  Pierre Dupont,et al.  Ensemble Logistic Regression for Feature Selection , 2011, PRIB.

[2]  Wei Wang,et al.  Development of a Real-Time Crash Risk Prediction Model Incorporating the Various Crash Mechanisms Across Different Traffic States , 2015, Traffic injury prevention.

[3]  Miguel Lázaro-Gredilla,et al.  Spike and Slab Variational Inference for Multi-Task and Multiple Kernel Learning , 2011, NIPS.

[4]  R. Stephenson.  A and V , 1962, The British journal of ophthalmology.

[5]  J. Hogg.  Quantitative remote sensing of land surfaces , 2004 .

[6]  Kenneth Kreutz-Delgado,et al.  Strong Sub- and Super-Gaussianity , 2010, LVA/ICA.

[7]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[8]  Ute Beyer,et al.  Remote Sensing And Image Interpretation , 2016 .

[9]  Jian Yang,et al.  Regularized Robust Coding for Face Recognition , 2012, IEEE Transactions on Image Processing.

[10]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[11]  Aggelos K. Katsaggelos,et al.  Bayesian Active Remote Sensing Image Classification , 2013 .

[12]  Aggelos K. Katsaggelos,et al.  Bayesian classification and active learning using lp-priors. Application to image segmentation , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[13]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[14]  Kaustubh Supekar,et al.  Sparse logistic regression for whole-brain classification of fMRI data , 2010, NeuroImage.

[15]  Mike E. Davies,et al.  Latent Variable Analysis and Signal Separation , 2010 .

[16]  Luis Gómez-Chova,et al.  Urban monitoring using multi-temporal SAR and multi-spectral data , 2006, Pattern Recognit. Lett..

[17]  Aggelos K. Katsaggelos,et al.  Variational Gaussian process for sensor fusion , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[18]  Luis Gómez-Chova,et al.  Remote Sensing Image Processing , 2011, Remote Sensing Image Processing.

[19]  W. Marsden.  I and J , 2012 .

[20]  Lorenzo Bruzzone,et al.  Kernel methods for remote sensing data analysis , 2009 .

[21]  Aggelos K. Katsaggelos,et al.  Bayesian Blind Deconvolution with General Sparse Image Priors , 2012, ECCV.

[22]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[23]  Neil D. Lawrence,et al.  Bayesian Gaussian Process Latent Variable Model , 2010, AISTATS.

[24]  Xu Zhou,et al.  Variational Bayesian Blind Image Deconvolution: A review , 2015, Digit. Signal Process..

[25]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[26]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[27]  Jun Li,et al.  Real-Time Implementation of the Sparse Multinomial Logistic Regression for Hyperspectral Image Classification on GPUs , 2015, IEEE Geoscience and Remote Sensing Letters.

[28]  Guillaume Bouchard.  Efficient Bounds for the Softmax Function and Applications to Approximate Inference in Hybrid models , 2008 .