HEp-2 Cell Image Classification With Deep Convolutional Neural Networks

Efficient Human Epithelial-2 cell image classification can facilitate the diagnosis of many autoimmune diseases. This paper proposes an automatic framework for this classification task, by utilizing the deep convolutional neural networks (CNNs) which have recently attracted intensive attention in visual recognition. In addition to describing the proposed classification framework, this paper elaborates several interesting observations and findings obtained by our investigation. They include the important factors that impact network design and training, the role of rotation-based data augmentation for cell images, the effectiveness of cell image masks for classification, and the adaptability of the CNN-based classification system across different datasets. Extensive experimental study is conducted to verify the above findings and compares the proposed framework with the well-established image classification models in the literature. The results on benchmark datasets demonstrate that 1) the proposed framework can effectively outperform existing models by properly applying data augmentation, 2) our CNN-based framework has excellent adaptability across different datasets, which is highly desirable for cell image classification under varying laboratory settings. Our system is ranked high in the cell image classification competition hosted by ICPR 2014.

[1]  David Svoboda,et al.  Efficient k-NN based HEp-2 cells classifier , 2014, Pattern Recognit..

[2]  Giulio Iannello,et al.  Indirect immunofluorescence in autoimmune diseases: Assessment of digital images for diagnostic purpose , 2007, Cytometry. Part B, Clinical cytometry.

[3]  Jian Wang,et al.  High-Order Statistics of Microtexton for HEp-2 Staining Pattern Classification , 2014, IEEE Transactions on Biomedical Engineering.

[4]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[5]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Jesús Angulo,et al.  Advanced Statistical Matrices for Texture Characterization: Application to Cell Classification , 2014, IEEE Transactions on Biomedical Engineering.

[7]  LinLin Shen,et al.  HEp-2 image classification using intensity order pooling based features and bag of words , 2014, Pattern Recognit..

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  Stephen J. McKenna,et al.  HEp-2 Cell Classification Using Multi-resolution Local Patterns and Ensemble SVMs , 2014 .

[13]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  P. Schur,et al.  ANA screening: an old test with new recommendations , 2010, Annals of the rheumatic diseases.

[15]  Kunihiko Fukushima,et al.  Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position , 1982, Pattern Recognit..

[16]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Alessia Saggese,et al.  Pattern recognition in stained HEp-2 cells: Where are we now? , 2014, Pattern Recognit..

[18]  Stephen J. McKenna,et al.  HEp-2 Cell Classification Using Multi-resolution Local Patterns and Ensemble SVMs , 2014, 2014 1st Workshop on Pattern Recognition Techniques for Indirect Immunofluorescence Images.

[19]  Fei-Fei Li,et al.  What Does Classifying More Than 10, 000 Image Categories Tell Us? , 2010, ECCV.

[20]  Lei Wang,et al.  In defense of soft-assignment coding , 2011, 2011 International Conference on Computer Vision.

[21]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[22]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[23]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[24]  Luca Maria Gambardella,et al.  Assessment of algorithms for mitosis detection in breast cancer histopathology images , 2014, Medical Image Anal..

[25]  Cor J. Veenman,et al.  Kernel Codebooks for Scene Categorization , 2008, ECCV.

[26]  Dimitris Kastaniotis,et al.  HEp-2 cells classification via sparse representation of textural features fused into dissimilarity space , 2014, Pattern Recognit..

[27]  Abderrahim Elmoataz,et al.  Multiscale Convolutional Neural Networks for Vision-Based Classification of Cells , 2012, ACCV.

[28]  Rasmus Larsen,et al.  HEp-2 Cell Classification Using Shape Index Histograms With Donut-Shaped Spatial Pooling , 2014, IEEE Transactions on Medical Imaging.

[29]  Wenyin Liu,et al.  HEp-2 cell pattern classification with discriminative dictionary learning , 2014, Pattern Recognit..

[30]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[31]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[32]  Florent Perronnin,et al.  Fisher Kernels on Visual Vocabularies for Image Categorization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[34]  Cordelia Schmid,et al.  Aggregating local descriptors into a compact image representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[36]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[37]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[38]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[39]  Brian C. Lovell,et al.  Fisher tensors for classifying human epithelial cells , 2014, Pattern Recognit..

[40]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[41]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[42]  Dimitris Kastaniotis,et al.  HEp-2 Cells Classification Using Morphological Features and a Bundle of Local Gradient Descriptors , 2014 .

[43]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[44]  Dong-Chen He,et al.  Texture Unit, Texture Spectrum, And Texture Analysis , 1990 .

[45]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[46]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[47]  Kazuhiro Fukui,et al.  HEp-2 cell classification using rotation invariant co-occurrence among local binary patterns , 2014, Pattern Recognit..

[48]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Dong-Chen He,et al.  Texture Unit, Texture Spectrum And Texture Analysis , 1989, 12th Canadian Symposium on Remote Sensing Geoscience and Remote Sensing Symposium,.

[50]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[52]  Lei Wang,et al.  HEp-2 Cell Image Classification with Convolutional Neural Networks , 2014, 2014 1st Workshop on Pattern Recognition Techniques for Indirect Immunofluorescence Images.

[53]  Yongkang Wong,et al.  Automatic Classification of Human Epithelial Type 2 Cell Indirect Immunofluorescence Images using Cell Pyramid Matching , 2014, bioRxiv.

[54]  Luisa Verdoliva,et al.  Biologically-Inspired Dense Local Descriptor for Indirect Immunofluorescence Image Classification , 2014, 2014 1st Workshop on Pattern Recognition Techniques for Indirect Immunofluorescence Images.

[55]  Mario Vento,et al.  Benchmarking HEp-2 Cells Classification Methods , 2013, IEEE Transactions on Medical Imaging.