Automating cell detection and classification in human brain fluorescent microscopy images using dictionary learning and sparse coding

BACKGROUND Immunofluorescence (IF) plays a major role in quantifying protein expression in situ and understanding cell function. It is widely applied in assessing disease mechanisms and in drug discovery research. Automation of IF analysis can transform studies using experimental cell models. However, IF analysis of postmortem human tissue relies mostly on manual interaction, often subjected to low-throughput and prone to error, leading to low inter and intra-observer reproducibility. Human postmortem brain samples challenges neuroscientists because of the high level of autofluorescence caused by accumulation of lipofuscin pigment during aging, hindering systematic analyses. We propose a method for automating cell counting and classification in IF microscopy of human postmortem brains. Our algorithm speeds up the quantification task while improving reproducibility. NEW METHOD Dictionary learning and sparse coding allow for constructing improved cell representations using IF images. These models are input for detection and segmentation methods. Classification occurs by means of color distances between cells and a learned set. RESULTS Our method successfully detected and classified cells in 49 human brain images. We evaluated our results regarding true positive, false positive, false negative, precision, recall, false positive rate and F1 score metrics. We also measured user-experience and time saved compared to manual countings. COMPARISON WITH EXISTING METHODS We compared our results to four open-access IF-based cell-counting tools available in the literature. Our method showed improved accuracy for all data samples. CONCLUSION The proposed method satisfactorily detects and classifies cells from human postmortem brain IF images, with potential to be generalized for applications in other counting tasks.

[1]  Lea T. Grinberg,et al.  A novel approach for integrative studies on neurodegenerative diseases in human brains , 2014, Journal of Neuroscience Methods.

[2]  Edward J. Delp,et al.  Boundary fitting based segmentation of fluorescence microscopy images , 2015, Electronic Imaging.

[3]  Olli Yli-Harja,et al.  Software for quantification of labeled bacteria from digital microscope images by automated image analysis. , 2005, BioTechniques.

[4]  David G. Stork,et al.  Pattern Classification , 1973 .

[5]  Daniela Ushizima,et al.  Segmentation of subcellular compartments combining superpixel representation with Voronoi diagrams , 2015 .

[6]  Michael Elad,et al.  Learning Multiscale Sparse Representations for Image and Video Restoration , 2007, Multiscale Model. Simul..

[7]  Katharina D'Herde,et al.  Optimizing Multiple Immunostaining of Neural Tissue , 2012 .

[8]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[9]  Haichao Zhu,et al.  A New Method to Assist Small Data Set Neural Network Learning , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[10]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[11]  Hamid Amiri,et al.  Adaptive automatic segmentation of leishmaniasis parasite in indirect immunofluorescence images , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Ricardo Nitrini,et al.  Post-Mortem diagnosis of dementia by informant interview , 2010, Dementia & neuropsychologia.

[13]  Junbin Gao,et al.  Image Segmentation Using Dictionary Learning and Compressed Random Features , 2014, 2014 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[14]  Guillermo Sapiro,et al.  Classification and clustering via dictionary learning with structured incoherence and shared features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Ting Chen,et al.  Deep Learning Based Automatic Immune Cell Detection for Immunohistochemistry Images , 2014, MLMI.

[16]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[17]  Ivan V. Grishagin,et al.  Automatic cell counting with ImageJ. , 2015, Analytical biochemistry.

[18]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[19]  S. Mallat,et al.  Adaptive greedy approximations , 1997 .

[20]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[21]  Md. Razaul Karim,et al.  Cytosolic LC3 ratio as a quantitative index of macroautophagy. , 2009, Methods in enzymology.

[22]  Claudia M. Carneiro,et al.  Automated Pap Smear Cell Analysis: Optimizing the Cervix Cytological Examination , 2013, 2013 12th International Conference on Machine Learning and Applications.

[23]  William F. Eddy,et al.  A novel algorithm for optimal image thresholding of biological data , 2010, Journal of Neuroscience Methods.

[24]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[25]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[26]  Ricardo Nitrini,et al.  Brain bank of the Brazilian aging brain study group—a milestone reached and more than 1,600 collected brains , 2006, Cell and Tissue Banking.

[27]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[28]  Badrinath Roysam,et al.  A hybrid 3D watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks , 2003, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[29]  L. Cauller,et al.  Reduction of background autofluorescence in brain sections following immersion in sodium borohydride , 1998, Journal of Neuroscience Methods.

[30]  Jon H. Kaas,et al.  How to count cells: the advantages and disadvantages of the isotropic fractionator compared with stereology , 2015, Cell and Tissue Research.

[31]  J H Price,et al.  Accuracy of least squares designed spatial FIR filters for segmentation of images of fluorescence stained cell nuclei. , 1996, Cytometry.

[32]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[33]  Robert A. Sweet,et al.  An automated segmentation methodology for quantifying immunoreactive puncta number and fluorescence intensity in tissue sections , 2008, Brain Research.

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Martin Han,et al.  A multispectral LED array for the reduction of background autofluorescence in brain tissue , 2013, Journal of Neuroscience Methods.

[36]  David G. Kirsch,et al.  Quantitative Segmentation of Fluorescence Microscopy Images of Heterogeneous Tissue: Application to the Detection of Residual Disease in Tumor Margins , 2013, PloS one.

[37]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[38]  Fusheng Wang,et al.  Automated cell segmentation with 3D fluorescence microscopy images , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[39]  Karl Rohr,et al.  Efficient globally optimal segmentation of cells in fluorescence microscopy images using level sets and convex energy functionals , 2012, Medical Image Anal..

[40]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[41]  Christoph Schmitz,et al.  Celloidin mounting (embedding without infiltration) — a new, simple and reliable method for producing serial sections of high thickness through complete human brains and its application to stereological and immunohistochemical investigations , 2000, Journal of Chemical Neuroanatomy.

[42]  K. G. Baker,et al.  The human locus coeruleus complex: an immunohistochemical and three dimensional reconstruction study , 2004, Experimental Brain Research.

[43]  Wiro J. Niessen,et al.  Advanced level-set based multiple-cell segmentation and tracking in time-lapse fluorescence microscopy images , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[44]  Jelena Kovacevic,et al.  Active Mask Segmentation of Fluorescence Microscope Images , 2009, IEEE Transactions on Image Processing.

[45]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[46]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[47]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Data Mining Researchers , 2003 .

[48]  Charles Duyckaerts,et al.  National Institute on Aging–Alzheimer’s Association guidelines for the neuropathologic assessment of Alzheimer’s disease: a practical approach , 2011, Acta Neuropathologica.

[49]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[50]  Ivo F. Sbalzarini,et al.  A Parallel Distributed-Memory Particle Method Enables Acquisition-Rate Segmentation of Large Fluorescence Microscopy Images , 2016, PloS one.

[51]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[52]  J. Schneider,et al.  National Institute on Aging–Alzheimer's Association guidelines for the neuropathologic assessment of Alzheimer's disease , 2012, Alzheimer's & Dementia.

[53]  Kevin M. Ryan,et al.  Analysis of macroautophagy by immunohistochemistry , 2012, Autophagy.

[54]  Kareem Soliman,et al.  CellProfiler: Novel Automated Image Segmentation Procedure for Super-Resolution Microscopy , 2015, Biological Procedures Online.

[55]  H. Braak,et al.  The evolution of Alzheimer's disease‐related cytoskeletal pathology in the human raphe nuclei , 2000, Neuropathology and applied neurobiology.

[56]  S. Mallat A wavelet tour of signal processing , 1998 .

[57]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[58]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[59]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[60]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[61]  Jeff Skinner,et al.  Characterizing and Diminishing Autofluorescence in Formalin-fixed Paraffin-embedded Human Respiratory Tissue , 2014, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[62]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[63]  J H Dowson,et al.  The evaluation of autofluorescence emission spectra derived from neuronal lipopigment , 1982, Journal of microscopy.

[64]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[65]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..