Two-hierarchical nonnegative matrix factorization distinguishing the fluorescent targets from autofluorescence for fluorescence imaging

BackgroundNonnegative matrix factorization (NMF) has been used in blind fluorescence unmixing for multispectral in-vivo fluorescence imaging, which decomposes a mixed source data into a set of constituent fluorescence spectra and corresponding concentrations. However, most classical NMF algorithms have ill convergence problems and they always fail to unmix multiple fluorescent targets from background autofluorescence for the sparse acquisition of multispectral fluorescence imaging, which introduces incomplete measurements and severe discontinuities in multispectral fluorescence emissions across the multiple spectral bands.MethodsObserving the spatial distinction between the diffusive autofluorescence and the sparse fluorescent targets, we propose to separate the mixed sparse multispectral data into equality constrained two-hierarchical updating within NMF framework by dividing the concentration matrix of entire endmembers into two hierarchies: the fluorescence targets and the background autofluorescence. Specifically, when updating concentrations of multiple fluorescent targets in the two-hierarchical NMF, we assume that the concentration of autofluorescence is fixed and known, and vice versa. Furthermore, a sparsity constraint is imposed on the concentration matrix components of fluorescence targets only.ResultsSynthetic data sets, in vivo fluorescence imaging data are employed to demonstrate and validate the performance of our approach. The proposed algorithm can achieve more satisfying results of spectral unmixing and autofluorescence removal compared to other state-of-the-art methods, especially for the sparse multispectral fluorescence imaging.ConclusionsThe proposed algorithm can successfully tackle the sparse acquisition and ill-posed problems in the NMF-based fluorescence unmixing through equality constraint along with partial sparsity constraint during two-hierarchical NMF optimization, at which fixing sparsity constrained target fluorescence can make the update of autofluorescence as accurate as possible and vice versa.

[1]  Zhenwei Shi,et al.  Nonnegative matrix factorization for hyperspectral unmixing using prior knowledge of spectral signatures , 2012 .

[2]  Mireille Guillaume,et al.  HALS-based NMF with flexible constraints for hyperspectral unmixing , 2012, EURASIP J. Adv. Signal Process..

[3]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[4]  Aapo Hyvärinen,et al.  Learning Natural Image Structure with a Horizontal Product Model , 2009, ICA.

[5]  Dongrong Xu,et al.  Review of spectral imaging technology in biomedical engineering: achievements and challenges , 2013, Journal of biomedical optics.

[6]  Laurent Tits,et al.  Reducing background effects in orchards through spectral vegetation index correction , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[7]  Sen Jia,et al.  Hierarchical alternating least squares algorithm with Sparsity Constraint for hyperspectral unmixing , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Xue Xiao,et al.  A novel initialization method for nonnegative matrix factorization and its application in component recognition with three-dimensional fluorescence spectra. , 2012, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[9]  F. Meer The effectiveness of spectral similarity measures for the analysis of hyperspectral imagery , 2006 .

[10]  M. Zimmer GFP: from jellyfish to the Nobel prize and beyond. , 2009, Chemical Society reviews.

[11]  Carlos Ortiz-de-Solorzano,et al.  Efficient Blind Spectral Unmixing of Fluorescently Labeled Samples Using Multi-Layer Non-Negative Matrix Factorization , 2013, PloS one.

[12]  Xiaodong Tao,et al.  Autofluorescence Removal by Non-Negative Matrix Factorization , 2011, IEEE Transactions on Image Processing.

[13]  Fabian J Theis,et al.  Blind source separation techniques for the decomposition of multiply labeled fluorescence images. , 2009, Biophysical journal.

[14]  Jean-Marc Dinten,et al.  In Vivo Fluorescence Spectra Unmixing and Autofluorescence Removal by Sparse Nonnegative Matrix Factorization , 2011, IEEE Transactions on Biomedical Engineering.

[15]  P. Paatero,et al.  Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values† , 1994 .

[16]  B. Rice,et al.  In-vivo fluorescence imaging with a multivariate curve resolution spectral unmixing technique. , 2009, Journal of biomedical optics.

[17]  Haishan Zeng,et al.  Cutaneous melanin exhibiting fluorescence emission under near-infrared light excitation. , 2006, Journal of biomedical optics.

[18]  Hyunsoo Kim,et al.  Sparse Non-negative Matrix Factorizations via Alternating Non-negativity-constrained Least Squares , 2006 .

[19]  Scott C Davis,et al.  Pre-clinical whole-body fluorescence imaging: Review of instruments, methods and applications. , 2010, Journal of photochemistry and photobiology. B, Biology.

[20]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[21]  Le Wang,et al.  Incorporating spatial information in spectral unmixing: A review , 2014 .

[22]  Jean-Marc Dinten,et al.  Nonnegative matrix factorization: a blind spectra separation method for in vivo fluorescent optical imaging. , 2010, Journal of biomedical optics.

[23]  Andrzej Cichocki,et al.  Hierarchical ALS Algorithms for Nonnegative Matrix and 3D Tensor Factorization , 2007, ICA.

[24]  Hans C Gerritsen,et al.  Blind unmixing of spectrally resolved lifetime images , 2013, Journal of biomedical optics.

[25]  M. V. Van Benthem,et al.  Application of equality constraints on variables during alternating least squares procedures , 2002 .

[26]  Antonio J. Plaza,et al.  A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Javier A. Jo,et al.  Blind End-Member and Abundance Extraction for Multispectral Fluorescence Lifetime Imaging Microscopy Data , 2014, IEEE Journal of Biomedical and Health Informatics.

[28]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[29]  Nicolas Gillis Nonnegative matrix factorization : complexity, algorithms and applications , 2011 .

[30]  Nicolas Gillis,et al.  Accelerated Multiplicative Updates and Hierarchical ALS Algorithms for Nonnegative Matrix Factorization , 2011, Neural Computation.

[31]  J Popp,et al.  Combining multiset resolution and segmentation for hyperspectral image analysis of biological tissues. , 2015, Analytica chimica acta.