Change detection based on tensor RPCA for longitudinal retinal fundus images

Abstract Change detection of longitudinal fundus images is an important problem in computer aided diagnosis system (CAD). Detecting regions of change in multiple fundus images from the same eye is seldom developed in the literature due to the complication and interpretability. This paper presents a longitudinal change detection framework based on tensor robust principal component analysis (RPCA) for a long retinal fundus image serial. The proposed method chooses an image of the best condition in serial as the background, then models each image as a slice of tensor, utilizes total variation to constraint the temporal continuity of change regions, finally obtains the change regions by Tucker decomposition and alternating direction method of multipliers (ADMM). Comparing with the method based on matrix RPCA, tensor RPCA preserves the original spatial structure of each image, imposes the temporal continuity on change regions and models the background by patches to avoid the little disturbance of blood vessels. Results on a real fundus image serial are presented and show the effectiveness of the proposed algorithm.

[1]  P F Sharp,et al.  The preprocessing of retinal images for the detection of fluorescein leakage. , 1999, Physics in medicine and biology.

[2]  U. Rajendra Acharya,et al.  Computer-aided diagnosis of diabetic retinopathy: A review , 2013, Comput. Biol. Medicine.

[3]  Daniel P. Robinson,et al.  A Flexible ADMM Algorithm for Big Data Applications , 2015, J. Sci. Comput..

[4]  Fabrice Heitz,et al.  Longitudinal change detection in diffusion MRI using multivariate statistical testing on tensors , 2012, NeuroImage.

[5]  Namrata Vaswani,et al.  An Online Algorithm for Separating Sparse and Low-Dimensional Signal Sequences From Their Sum , 2013, IEEE Transactions on Signal Processing.

[6]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[7]  Wei Feng,et al.  Fast and Reliable Computational Rephotography on Mobile Device , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[9]  Xiaoqiang Lu,et al.  A Coarse-to-Fine Semi-Supervised Change Detection for Multispectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Maoguo Gong,et al.  Superpixel-Based Difference Representation Learning for Change Detection in Multispectral Remote Sensing Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[13]  Thierry Bouwmans,et al.  Recent Advanced Statistical Background Modeling for Foreground Detection - A Systematic Survey , 2011 .

[14]  Qian Zhang,et al.  Active Camera Relocalization from a Single Reference Image without Hand-Eye Calibration , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Charles V. Stewart,et al.  Robust detection and classification of longitudinal changes in color retinal fundus images for monitoring diabetic retinopathy , 2006, IEEE Transactions on Biomedical Engineering.

[16]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[17]  Lucas J. van Vliet,et al.  An Automated System for the Detection and Classification of Retinal Changes Due to Red Lesions in Longitudinal Fundus Images , 2018, IEEE Transactions on Biomedical Engineering.

[18]  Andrzej Cichocki,et al.  Total Variation Regularized Tensor RPCA for Background Subtraction From Compressive Measurements , 2015, IEEE Transactions on Image Processing.

[19]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[20]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[21]  Aswin C. Sankaranarayanan,et al.  SpaRCS: Recovering low-rank and sparse matrices from compressive measurements , 2011, NIPS.

[22]  Benzhi Chen,et al.  Automatic Detection of Longitudinal Changes for Retinal Fundus Images Based on Low-Rank Decomposition , 2018 .

[23]  Hong Jiang,et al.  Surveillance Video Analysis Using Compressive Sensing With Low Latency , 2014, Bell Labs Tech. J..

[24]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[25]  Adam G. Thomas,et al.  Detection of Focal Longitudinal Changes in the Brain by Subtraction of MR Images , 2017, American Journal of Neuroradiology.

[26]  Hong Jiang,et al.  Surveillance Video Processing Using Compressive Sensing , 2012, ArXiv.

[27]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[28]  U. Rajendra Acharya,et al.  Algorithms for the Automated Detection of Diabetic Retinopathy Using Digital Fundus Images: A Review , 2012, Journal of Medical Systems.

[29]  Philip J. Morrow,et al.  Algorithms for digital image processing in diabetic retinopathy , 2009, Comput. Medical Imaging Graph..

[30]  Thierry Bouwmans,et al.  Subspace Learning for Background Modeling: A Survey , 2009 .

[31]  Swati Mishra,et al.  Blur-invariant copy-move forgery detection technique with improved detection accuracy utilising SWT-SVD , 2017, IET Image Process..

[32]  Ping Tan,et al.  Active Recurrence of Lighting Condition for Fine-Grained Change Detection , 2018, IJCAI.

[33]  J. You,et al.  Robust Object Extraction and Change Detection in Retinal Images for Diabetic Clinical Studies , 2007, 2007 IEEE Symposium on Computational Intelligence in Image and Signal Processing.

[34]  Xiangtao Zheng,et al.  Joint Dictionary Learning for Multispectral Change Detection , 2017, IEEE Transactions on Cybernetics.

[35]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Jizhou Sun,et al.  Fine-Grained Change Detection of Misaligned Scenes with Varied Illuminations , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[37]  Jizhou Sun,et al.  Learning to Detect Fine-Grained Change Under Variant Imaging Conditions , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[38]  João M. F. Xavier,et al.  D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization , 2012, IEEE Transactions on Signal Processing.

[39]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[40]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[41]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[42]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..