Immersive Interactive SAR Image Representation Using Non-negative Matrix Factorization

Earth observation (EO) images clustering is a challenging problem in data mining, where each image is represented by a high-dimensional feature vector. However, the feature vectors might not be appropriate to express the semantic content of images, which eventually lead to poor results in clustering and classification. To tackle this problem, we propose an interactive approach to generate compact and informative features from images content. To this end, we utilize a 3-D interactive application to support user-images interactions. These interactions are used in the context of two novel nonnegative matrix factorization (NMF) algorithms to generate new features. We assess the quality of new features by applying k-means clustering on the generated features and compare the obtained clustering results with those achieved by original features. We perform experiments on a synthetic aperture radar (SAR) image dataset represented by different state-of-the-art features and demonstrate the effectiveness of the proposed method. Moreover, we propose a divide-and-conquer approach to cluster a massive amount of images using a small subset of interactions.

[1]  Jing Hua,et al.  Non-negative matrix factorization for semi-supervised data clustering , 2008, Knowledge and Information Systems.

[2]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Seungjin Choi,et al.  Semi-Supervised Nonnegative Matrix Factorization , 2010, IEEE Signal Processing Letters.

[5]  Chitra Dorai,et al.  Bridging the semantic gap with computational media aesthetics , 2003, IEEE MultiMedia.

[6]  Inderjit S. Dhillon,et al.  Semi-supervised graph clustering: a kernel approach , 2005, ICML '05.

[7]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[8]  Jinfeng Yi,et al.  Semi-Crowdsourced Clustering: Generalizing Crowd Labeling by Robust Distance Metric Learning , 2012, NIPS.

[9]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[10]  Mihai Datcu,et al.  Immersive Interactive Information Mining with Application to Earth Observation Data Retrieval , 2013, CD-ARES.

[11]  Carla E. Brodley,et al.  Proceedings of the twenty-first international conference on Machine learning , 2004, International Conference on Machine Learning.

[12]  M. Pietikäinen,et al.  A robust descriptor based on Weber’s Law , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[14]  Mihai Datcu,et al.  Immersive visualization of visual data using nonnegative matrix factorization , 2016, Neurocomputing.

[15]  Mihai Datcu,et al.  Farness preserving Non-negative matrix factorization , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  David Wessel,et al.  Accelerating Non-Negative Matrix Factorization for Audio Source Separation on Multi-Core and Many-Core Architectures , 2009, ISMIR.

[17]  Chris H. Q. Ding,et al.  Solving Consensus and Semi-supervised Clustering Problems Using Nonnegative Matrix Factorization , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[18]  H. Creagh.  Cave Automatic Virtual Environment , 2003, Proceedings: Electrical Insulation Conference and Electrical Manufacturing and Coil Winding Technology Conference (Cat. No.03CH37480).

[19]  Mihai Datcu,et al.  Discriminative Nonnegative Matrix Factorization for dimensionality reduction , 2016, Neurocomputing.

[20]  Hong Sun,et al.  Unsupervised Feature Learning Via Spectral Clustering of Multidimensional Patches for Remotely Sensed Scene Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[22]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[23]  Michel Verleysen,et al.  Nonlinear Dimensionality Reduction , 2021, Computer Vision.

[24]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[25]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[26]  Fei Wang,et al.  Semi-Supervised Clustering via Matrix Factorization , 2008, SDM.

[27]  Shiyong Cui,et al.  Ratio-Detector-Based Feature Extraction for Very High Resolution SAR Image Patch Indexing , 2013, IEEE Geoscience and Remote Sensing Letters.

[28]  Mihai Datcu,et al.  Visualization-Based Active Learning for the Annotation of SAR Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Raymond J. Mooney,et al.  Integrating constraints and metric learning in semi-supervised clustering , 2004, ICML.

[30]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..