Image Understanding Applications of Lattice Autoassociative Memories

Multivariate mathematical morphology (MMM) aims to extend the mathematical morphology from gray scale images to images whose pixels are high-dimensional vectors, such as remote sensing hyperspectral images and functional magnetic resonance images (fMRIs). Defining an ordering over the multidimensional image data space is a fundamental issue MMM, to ensure that ensuing morphological operators and filters are mathematically consistent. Recent approaches use the outputs of two-class classifiers to build such reduced orderings. This paper presents the applications of MMM built on reduced supervised orderings based on lattice autoassociative memories (LAAMs) recall error measured by the Chebyshev distance. Foreground supervised orderings use one set of training data from a foreground class, whereas background/foreground supervised orderings use two training data sets, one for each relevant class. The first case study refers to the realization of the thematic segmentation of the hyperspectral images using spatial-spectral information. Spectral classification is enhanced by a spatial processing consisting in the spatial correction guided by a watershed segmentation computed by the LAAM-based morphological operators. The approach improves the state-of-the-art hyperspectral spatial-spectral thematic map building approaches. The second case study is the analysis of resting state fMRI data, working on a data set of healthy controls, schizophrenia patients with and without auditory hallucinations. We perform two experiments: 1) the localization of differences in brain functional networks on population-dependent templates and 2) the classification of subjects into each possible pair of cases. In this data set, we find that the LAAM-based morphological features improve over the conventional correlation-based graph measure features often employed in fMRI data classification.

[1]  Manuel Graña,et al.  Lattice independent component analysis for functional magnetic resonance imaging , 2011, Inf. Sci..

[2]  Richard J. Duro,et al.  An Adaptive Approach for the Progressive Integration of Spatial and Spectral Features When Training Ground-Based Hyperspectral Imaging Classifiers , 2010, IEEE Transactions on Instrumentation and Measurement.

[3]  Jon Atli Benediktsson,et al.  A spatial-spectral kernel-based approach for the classification of remote-sensing images , 2012, Pattern Recognit..

[4]  Manuel Graña,et al.  Hybrid multivariate morphology using lattice auto-associative memories for resting-state fMRI network discovery , 2012, 2012 12th International Conference on Hybrid Intelligent Systems (HIS).

[5]  Peter Sussner,et al.  Morphological bidirectional associative memories , 1999, Neural Networks.

[6]  Goo Jun,et al.  Spatially Adaptive Classification of Land Cover With Remote Sensing Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Chunshui Yu,et al.  Altered resting-state functional connectivity and anatomical connectivity of hippocampus in schizophrenia , 2008, Schizophrenia Research.

[8]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[9]  Sébastien Lefèvre,et al.  A comparative study on multivariate mathematical morphology , 2007, Pattern Recognit..

[10]  Dietmar Cordes,et al.  Hierarchical clustering to measure connectivity in fMRI resting-state data. , 2002, Magnetic resonance imaging.

[11]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[12]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[13]  Manuel Graña,et al.  Lattice computing in hybrid intelligent systems , 2012, 2012 12th International Conference on Hybrid Intelligent Systems (HIS).

[14]  Jonathan D. Power,et al.  Prediction of Individual Brain Maturity Using fMRI , 2010, Science.

[15]  Esa Ollila,et al.  Effects of repeatability measures on results of fMRI sICA: A study on simulated and real resting-state effects , 2011, NeuroImage.

[16]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[17]  Jun Li,et al.  ${{\rm E}^{2}}{\rm LMs}$ : Ensemble Extreme Learning Machines for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[19]  Jun Zhou,et al.  Multitask Sparse Nonnegative Matrix Factorization for Joint Spectral–Spatial Hyperspectral Imagery Denoising , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Jesús Angulo,et al.  Morphological colour operators in totally ordered lattices based on distances: Application to image filtering, enhancement and analysis , 2007, Comput. Vis. Image Underst..

[22]  Tianzi Jiang,et al.  Regional homogeneity, functional connectivity and imaging markers of Alzheimer's disease: A review of resting-state fMRI studies , 2008, Neuropsychologia.

[23]  Fernand Meyer,et al.  Topographic distance and watershed lines , 1994, Signal Process..

[24]  Lianru Gao,et al.  Adaptive Markov Random Field Approach for Classification of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[25]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Bin Luo,et al.  Supervised Hyperspectral Image Classification Based on Spectral Unmixing and Geometrical Features , 2011, J. Signal Process. Syst..

[27]  R Cameron Craddock,et al.  Disease state prediction from resting state functional connectivity , 2009, Magnetic resonance in medicine.

[28]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[29]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[30]  Jon Atli Benediktsson,et al.  Cluster-Based Ensemble Classification for Hyperspectral Remote Sensing Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[31]  Santiago Velasco-Forero,et al.  Improving Hyperspectral Image Classification Using Spatial Preprocessing , 2009, IEEE Geoscience and Remote Sensing Letters.

[32]  LinLin Shen,et al.  Three-Dimensional Gabor Wavelets for Pixel-Based Hyperspectral Imagery Classification , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jean Serra Anamorphoses and function lattices , 1993, Optics & Photonics.

[34]  Manuel Graña,et al.  A brief review of lattice computing , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[35]  Stephen M. Smith,et al.  Investigations into resting-state connectivity using independent component analysis , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[37]  V. Barnett The Ordering of Multivariate Data , 1976 .

[38]  George A. Papakostas,et al.  Learning Distributions of Image Features by Interactive Fuzzy Lattice Reasoning in Pattern Recognition Applications , 2015, IEEE Computational Intelligence Magazine.

[39]  Xiuping Jia,et al.  Simplified Conditional Random Fields With Class Boundary Constraint for Spectral-Spatial Based Remote Sensing Image Classification , 2012, IEEE Geoscience and Remote Sensing Letters.

[40]  Jon Atli Benediktsson,et al.  Ensemble methods for spectral-spatial classification of urban hyperspectral data , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[41]  Jon Atli Benediktsson,et al.  Multiple Spectral–Spatial Classification Approach for Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[42]  J. Pekar,et al.  A method for making group inferences from functional MRI data using independent component analysis , 2001, Human brain mapping.

[43]  André Aleman,et al.  Auditory Hallucinations in Schizophrenia Are Associated with Reduced Functional Connectivity of the Temporo-Parietal Area , 2010, Biological Psychiatry.

[44]  Paul D. Gader,et al.  Fixed Points of Lattice Transforms and Lattice Associative Memories , 2006 .

[45]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[46]  Shiliang Sun,et al.  A review of optimization methodologies in support vector machines , 2011, Neurocomputing.

[47]  Chin-Teng Lin,et al.  A Spatial–Contextual Support Vector Machine for Remotely Sensed Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[49]  Peter Sussner,et al.  Morphological associative memories , 1998, IEEE Trans. Neural Networks.

[50]  Yufeng Zang,et al.  Using Coherence to Measure Regional Homogeneity of Resting-State fMRI Signal , 2010, Front. Syst. Neurosci..

[51]  Ping Zhong,et al.  Learning Conditional Random Fields for Classification of Hyperspectral Images , 2010, IEEE Transactions on Image Processing.

[52]  Serge Beucher Segmentation d'images et morphologie mathématique , 1990 .

[53]  Yuan Zhou,et al.  Functional dysconnectivity of the dorsolateral prefrontal cortex in first-episode schizophrenia using resting-state fMRI , 2007, Neuroscience Letters.

[54]  Vince D. Calhoun,et al.  Investigation of relationships between fMRI brain networks in the spectral domain using ICA and Granger causality reveals distinct differences between schizophrenia patients and healthy controls , 2009, NeuroImage.

[55]  Chaozhe Zhu,et al.  An improved approach to detection of amplitude of low-frequency fluctuation (ALFF) for resting-state fMRI: Fractional ALFF , 2008, Journal of Neuroscience Methods.

[56]  M. V. D. Heuvel,et al.  Exploring the brain network: A review on resting-state fMRI functional connectivity , 2010, European Neuropsychopharmacology.

[57]  Jon Atli Benediktsson,et al.  Exploiting spectral and spatial information in hyperspectral urban data with high resolution , 2004, IEEE Geoscience and Remote Sensing Letters.

[58]  Gerd Wagner,et al.  ALTERED DEFAULT-MODE NETWORK ACTIVITY IN SCHIZOPHRENIA: A RESTING STATE FMRI STUDY , 2010, Schizophrenia Research.

[59]  Athanasios Kehagias,et al.  Fuzzy Inference System (FIS) Extensions Based on the Lattice Theory , 2014, IEEE Transactions on Fuzzy Systems.

[60]  Trac D. Tran,et al.  Exploiting Sparsity in Hyperspectral Image Classification via Graphical Models , 2013, IEEE Geoscience and Remote Sensing Letters.

[61]  Ping Zhong,et al.  Modeling and Classifying Hyperspectral Imagery by CRFs With Sparse Higher Order Potentials , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Gaojun Teng,et al.  Regional homogeneity in depression and its relationship with separate depressive symptom clusters: a resting-state fMRI study. , 2009, Journal of affective disorders.

[63]  Manuel Graña,et al.  Two lattice computing approaches for the unsupervised segmentation of hyperspectral images , 2009, Neurocomputing.

[64]  Peter Sussner,et al.  Gray-scale morphological associative memories , 2006, IEEE Transactions on Neural Networks.

[65]  Wei Wu,et al.  Spectral–Spatial Classification of Hyperspectral Images via Spatial Translation-Invariant Wavelet-Based Sparse Representation , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[66]  Ioannis Pitas,et al.  Multivariate ordering in color image filtering , 1991, IEEE Trans. Circuits Syst. Video Technol..

[67]  Shiming Xiang,et al.  Discriminant Tensor Spectral–Spatial Feature Extraction for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[68]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[69]  Manuel Graña,et al.  Results on a Lattice Computing Based Group Analysis of Schizophrenic Patients on Resting State fMRI , 2013, IWINAC.

[70]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[71]  Jon Atli Benediktsson,et al.  Segmentation and Classification of Hyperspectral Data using Watershed , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[72]  Justin T. Baker,et al.  Functional connectivity of left Heschl's gyrus in vulnerability to auditory hallucinations in schizophrenia , 2013, Schizophrenia Research.

[73]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .

[75]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[76]  Jesús Angulo,et al.  Supervised Ordering in ${\rm I}\!{\rm R}^p$: Application to Morphological Processing of Hyperspectral Images , 2011, IEEE Transactions on Image Processing.

[77]  Georg Northoff,et al.  The brain and its resting state activity—Experimental and methodological implications , 2010, Progress in Neurobiology.