A Unified Tensor Framework for Clustering and Simultaneous Reconstruction of Incomplete Imaging Data

Incomplete observations in the data are always troublesome to data clustering algorithms. In fact, most of the well-received techniques are not designed to encounter such imperative scenarios. Hence, clustering of images under incomplete samples is an inquisitive yet unaddressed area of research. Therefore, the aim of this article is to design a single-stage optimization procedure for clustering as well as simultaneous reconstruction of images without breaking the intrinsic spatial structure. The method employs the self-expressiveness property of submodules, and images are stacked as the lateral slices of a three-dimensional tensor. The proposed optimization method is designed to extract a sparse t-linear combination tensor with low multirank constraint, consisting of a unique set of linear coefficients in the form of mode-3 fibers and the spectral clustering is performed on these fibers. Simultaneously, the recovery of lost samples is accomplished by twisting the entire lateral slices of the data tensor and applying a low-rank approximation on each slice. The prominence of the proposed method lies in the simultaneous execution of data clustering and reconstruction of incomplete observations in a single step. Experimental results reveal the excellence of the proposed method over state-of-the-art clustering algorithms in the context of incomplete imaging data.

[1]  Yuan Xie,et al.  On Unifying Multi-view Self-Representations for Clustering by Tensor Multi-rank Minimization , 2016, International Journal of Computer Vision.

[2]  Murtaza Haider,et al.  Beyond the hype: Big data concepts, methods, and analytics , 2015, Int. J. Inf. Manag..

[3]  Lin Zhu,et al.  ${L_{1/2}}$ Norm and Spatial Continuity Regularized Low-Rank Approximation for Moving Object Detection in Dynamic Background , 2018, IEEE Signal Processing Letters.

[4]  Daniel P. Robinson,et al.  Sparse Subspace Clustering with Missing Entries , 2015, ICML.

[5]  Xiaodong Wang,et al.  Low-Tubal-Rank Tensor Completion Using Alternating Minimization , 2016, IEEE Transactions on Information Theory.

[6]  Sudhish N. George,et al.  Video Completion and Simultaneous Moving Object Detection for Extreme Surveillance Environments , 2019, IEEE Signal Processing Letters.

[7]  GandomiAmir,et al.  Beyond the hype , 2015 .

[8]  Waheed U. Bajwa,et al.  A Low Tensor-Rank Representation Approach for Clustering of Imaging Data , 2018, IEEE Signal Processing Letters.

[9]  Pavel Berkhin,et al.  A Survey of Clustering Data Mining Techniques , 2006, Grouping Multidimensional Data.

[10]  Hans-Peter Kriegel,et al.  Density-Based Clustering in Spatial Databases: The Algorithm GDBSCAN and Its Applications , 1998, Data Mining and Knowledge Discovery.

[11]  Mathews Jacob,et al.  Clustering of Data with Missing Entries , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Swagatam Das,et al.  Kernel-induced fuzzy clustering of image pixels with an improved differential evolution algorithm , 2010, Inf. Sci..

[13]  Lan Tang,et al.  Analyzing the Weighted Nuclear Norm Minimization and Nuclear Norm Minimization based on Group Sparse Representation , 2017, ArXiv.

[14]  Mark Sanderson,et al.  Christopher D. Manning, Prabhakar Raghavan, Hinrich Schütze, Introduction to Information Retrieval, Cambridge University Press 2008. ISBN-13 978-0-521-86571-5, xxi + 482 pages , 2010, Natural Language Engineering.

[15]  Misha Elena Kilmer,et al.  Clustering multi-way data: a novel algebraic approach , 2014, ArXiv.

[16]  Jonathan Cheung-Wai Chan,et al.  Hyperspectral Image Denoising Using Global Weighted Tensor Norm Minimum and Nonlocal Low-Rank Approximation , 2019, Remote. Sens..

[17]  Sudhish N. George,et al.  Ultrasound image despeckling using low rank matrix approximation approach , 2017, Biomed. Signal Process. Control..

[18]  Qiquan Shi,et al.  Feature Extraction for Incomplete Data Via Low-Rank Tensor Decomposition With Feature Regularization , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Sudhish N. George,et al.  Simultaneous denoising and moving object detection using low rank approximation , 2019, Future Gener. Comput. Syst..

[20]  Amir Averbuch,et al.  Missing Entries Matrix Approximation and Completion , 2013, ArXiv.

[21]  Allen Y. Yang,et al.  Estimation of Subspace Arrangements with Applications in Modeling and Segmenting Mixed Data , 2008, SIAM Rev..

[22]  Junbin Gao,et al.  A Submodule Clustering Method for Multi-way Data by Sparse and Low-Rank Representation , 2016, ArXiv.

[23]  Jie Zhang,et al.  Structure-Constrained Low-Rank Representation , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Yiu-Ming Cheung,et al.  Rank-One Matrix Completion With Automatic Rank Estimation via L1-Norm Regularization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Jianhong Wu,et al.  Data clustering - theory, algorithms, and applications , 2007 .

[26]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[27]  Gilad Lerman,et al.  Median K-Flats for hybrid linear modeling with many outliers , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[28]  Jonathan Cheung-Wai Chan,et al.  Nonconvex tensor rank minimization and its applications to tensor recovery , 2019, Inf. Sci..

[29]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[30]  Sudhish N. George,et al.  Tensor based approach for inpainting of video containing sparse text , 2018, Multimedia Tools and Applications.

[31]  Misha Elena Kilmer,et al.  Novel Factorization Strategies for Higher Order Tensors: Implications for Compression and Recovery of Multi-linear Data , 2013, ArXiv.

[32]  Meng Wang,et al.  Tri-Clustered Tensor Completion for Social-Aware Image Tag Refinement , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Wei Liu,et al.  Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Shuicheng Yan,et al.  Tensor Low-Rank Representation for Data Recovery and Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  David G. Stork,et al.  Pattern Classification , 1973 .

[37]  Qingming Huang,et al.  Beyond global fusion: A group-aware fusion approach for multi-view image clustering , 2019, Inf. Sci..

[38]  James Bailey,et al.  Adjusting for Chance Clustering Comparison Measures , 2015, J. Mach. Learn. Res..

[39]  Qi Tian,et al.  Enhancing Person Re-identification in a Self-Trained Subspace , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[40]  Nasir Ahmed,et al.  Recent review on image clustering , 2015, IET Image Process..

[41]  Liangpei Zhang,et al.  Spectral–Spatial Sparse Subspace Clustering for Hyperspectral Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Fan Liu,et al.  Truncated nuclear norm regularization for low-rank tensor completion , 2019, ArXiv.

[43]  Qi Tian,et al.  Social Anchor-Unit Graph Regularized Tensor Completion for Large-Scale Image Retagging , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Jiawei Han,et al.  Image clustering with tensor representation , 2005, ACM Multimedia.

[45]  Jonathan Cheung-Wai Chan,et al.  Nonlocal Low-Rank Regularized Tensor Decomposition for Hyperspectral Image Denoising , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[46]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[47]  Huan Liu,et al.  Subspace clustering for high dimensional data: a review , 2004, SKDD.

[48]  Hong Cheng,et al.  Trace Norm Regularized CANDECOMP/PARAFAC Decomposition With Missing Data , 2015, IEEE Transactions on Cybernetics.

[49]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[50]  Chin-Teng Lin,et al.  A review of clustering techniques and developments , 2017, Neurocomputing.

[51]  J. Schafer,et al.  Missing data: our view of the state of the art. , 2002, Psychological methods.

[52]  CandèsEmmanuel,et al.  Exact matrix completion via convex optimization , 2009 .

[53]  Emmanuel J. Candès,et al.  A Geometric Analysis of Subspace Clustering with Outliers , 2011, ArXiv.

[54]  Arthur Zimek,et al.  On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study , 2016, Data Mining and Knowledge Discovery.

[55]  Yingjie Tian,et al.  A Comprehensive Survey of Clustering Algorithms , 2015, Annals of Data Science.

[56]  Shuchin Aeron,et al.  Group-invariant Subspace Clustering , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[57]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Hongyu Zhao,et al.  Low-Rank Modeling and Its Applications in Image Analysis , 2014, ACM Comput. Surv..

[59]  Junbin Gao,et al.  Relations Among Some Low-Rank Subspace Recovery Models , 2014, Neural Computation.

[60]  LiuWei,et al.  Semi-supervised distance metric learning for collaborative image retrieval and clustering , 2010 .

[61]  Sudhish N. George,et al.  Twist tensor total variation regularized-reweighted nuclear norm based tensor completion for video missing area recovery , 2018, Inf. Sci..

[62]  Sudhish N. George,et al.  DCT based weighted adaptive multi-linear data completion and denoising , 2018, Neurocomputing.

[63]  S. Kleiman,et al.  A term of Commutative Algebra , 2013 .

[64]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[65]  S. N. George,et al.  A Three-Way Optimization Technique for Noise Robust Moving Object Detection Using Tensor Low-Rank Approximation, l1/2, and TTV Regularizations , 2019, IEEE Transactions on Cybernetics.

[66]  Wensheng Zhang,et al.  The Twist Tensor Nuclear Norm for Video Completion , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[67]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[68]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[69]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Michel Verleysen,et al.  The Curse of Dimensionality in Data Mining and Time Series Prediction , 2005, IWANN.

[71]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[72]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[73]  Wotao Yin,et al.  Parallel matrix factorization for low-rank tensor completion , 2013, ArXiv.