Convex formulation for hyperspectral image classification with superpixels

The superpixels provided by an unsupervised segmentation algorithm are sets of neighboring pixels homogeneous in some sense. Therefore it is very likely that, in a classification problem, most pixels in a superpixel belong to the same class, namely if the homogeneity criterion is compatible with the class statistics. Superpixels are, therefore, a powerful device to express spatial contextual information. However, the exploitation of superpixels in a principled way is not straightforward. Recent efforts attack this problem under a discrete optimization framework, by including regularization terms promoting consistence of the labels in the superpixels and computing approximate labelings with graph-cut algorithms. The well known hardness of integer optimization problems is a major limitation of this line of attack. In this paper, we introduce a new strategy, based on convex relaxation, to include the spatial information provided by superpixels in classification problems. The convex relaxation of an integer optimization problem opens a door to include extra information, such as spatial partitioning information given by over-segmented superpixels. The convex optimization problem thus obtained is solved by using SALSA algorithm. Experimental results with the ROSIS Pavia University dataset illustrate the effectiveness of the proposed framework.

[1]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[4]  Daniel Cremers,et al.  A convex relaxation approach for computing minimal partitions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Jon Atli Benediktsson,et al.  Multiple Spectral–Spatial Classification Approach for Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Xiuping Jia,et al.  Spectral-spatial based super pixel remote sensing image classification , 2011, 2011 4th International Congress on Image and Signal Processing.

[7]  Jiankun Hu,et al.  Superpixel-Based Graphical Model for Remote Sensing Image Mapping , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jan-Michael Frahm,et al.  Fast Global Labeling for Real-Time Stereo Using Multiple Plane Sweeps , 2008, VMV.

[9]  Daniel Cremers,et al.  The Natural Vectorial Total Variation Which Arises from Geometric Measure Theory , 2012, SIAM J. Imaging Sci..

[10]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[11]  Rainer Stiefelhagen,et al.  Improving foreground segmentations with probabilistic superpixel Markov random fields , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[13]  Daniel Cremers,et al.  A Survey and Comparison of Discrete and Continuous Multi-label Optimization Approaches for the Potts Model , 2013, International Journal of Computer Vision.

[14]  Roland Glowinski,et al.  On Alternating Direction Methods of Multipliers: A Historical Perspective , 2014, Modeling, Simulation and Optimization for Science and Technology.

[15]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[17]  Jelena Kovacevic,et al.  Alternating direction optimization for image segmentation using hidden Markov measure field models , 2014, Electronic Imaging.

[18]  Jelena Kovacevic,et al.  Supervised hyperspectral image segmentation: A convex formulation using hidden fields , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[19]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.