HEp-2 staining pattern recognition at cell and specimen levels: Datasets, algorithms and results

Updates the state of the art in HEp-2 cell and specimen image classification.Analyses and compares 15 methods tested over a common and very large dataset.Highlights the key elements of the best performing methods. The Indirect Immunofluorescence (IIF) protocol applied on Human Epithelial type 2 (HEp-2) cells is the current gold standard for the Antinuclear Antibody (ANA) test. The formulation of the diagnosis requires the visual analysis of a patients specimen under a fluorescence microscope in order to recognize the cells staining pattern which could be related to a connective tissue disease. This analysis is time consuming and error prone, thus in the recent past we have witnessed a growing interest in the pattern recognition scientific community directed at the development of methods for supporting this complex task. The main driver of the interest towards this problem is represented by the series of international benchmarking initiatives organized in the last four years that allowed dozens of research groups to propose innovative methodologies for HEp-2 cells staining pattern classification. In this paper we update the state of the art on HEp-2 cells and specimens classification, by analyzing the performance achieved by the methods participating the contest on Performance Evaluation of IIF Image Analysis Systems, hosted by the 22nd edition of the International Conference on Pattern Recognition ICPR 2014, and to the Executable Thematic Special Issue of Pattern Recognition Letters on Pattern Recognition Techniques for IIF Images Analysis, and by highlighting the trends in the design of the best performing methods.

[1]  Xueming Qian,et al.  PLBP: An effective local binary patterns texture descriptor with pyramid representation , 2011, Pattern Recognit..

[2]  Cristinel Codrescu.  Quadratic Recurrent Finite Impulse Response MLP for Indirect Immunofluorescence Image Recognition , 2014 .

[3]  Loris Nanni,et al.  Ensembles of dense and dense sampling descriptors for the HEp-2 cells classification problem , 2016, Pattern Recognit. Lett..

[4]  Xian-Hua Han,et al.  Integration of spatial and orientation contexts in local ternary patterns for HEp-2 cell classification , 2016, Pattern Recognit. Lett..

[5]  Alessia Saggese,et al.  Computer Aided Diagnosis for Anti-Nuclear Antibodies HEp-2 images: Progress and challenges , 2016, Pattern Recognit. Lett..

[6]  Anton van den Hengel,et al.  A Scalable Stagewise Approach to Large-Margin Multiclass Loss-Based Boosting , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Kazuhiro Fukui,et al.  Feature Extraction Based on Co-occurrence of Adjacent Local Binary Patterns , 2011, PSIVT.

[8]  A. Yuille,et al.  Dense Scale Invariant Descriptors for Images and Surfaces , 2012 .

[9]  Luisa Verdoliva,et al.  Cell image classification by a scale and rotation invariant dense local descriptor , 2016, Pattern Recognit. Lett..

[10]  Dimitris Kastaniotis,et al.  HEp-2 cells classification using locally aggregated features mapped in the dissimilarity space , 2013, 13th IEEE International Conference on BioInformatics and BioEngineering.

[11]  Stephen J. McKenna,et al.  HEp-2 Cell Classification Using Multi-resolution Local Patterns and Ensemble SVMs , 2014 .

[12]  A. Wiik,et al.  Antinuclear antibodies: a contemporary nomenclature using HEp-2 cells. , 2010, Journal of autoimmunity.

[13]  Cordelia Schmid,et al.  Aggregating Local Image Descriptors into Compact Codes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Alessia Saggese,et al.  Pattern recognition in stained HEp-2 cells: Where are we now? , 2014, Pattern Recognit..

[15]  Gennady V. Ponomarev,et al.  Classification of ANA HEp-2 slide images using morphological features of stained patterns , 2016, Pattern Recognit. Lett..

[16]  Paul S. Heckbert,et al.  Graphics gems IV , 1994 .

[17]  Kazuhiro Fukui,et al.  HEp-2 cell classification using rotation invariant co-occurrence among local binary patterns , 2014, Pattern Recognit..

[18]  Donato Cascio,et al.  A multi-process system for HEp-2 cells classification based on SVM , 2016, Pattern Recognit. Lett..

[19]  Dimitris Kastaniotis,et al.  HEp-2 Cells Classification Using Morphological Features and a Bundle of Local Gradient Descriptors , 2014 .

[20]  Pradipta Maji,et al.  Contraharmonic Mean Based Bias Field Correction in MR Images , 2013, CAIP.

[21]  Lei Wang,et al.  HEp-2 Cell Image Classification with Convolutional Neural Networks , 2014 .

[22]  Mario Vento,et al.  Benchmarking human epithelial type 2 interphase cells classification methods on a very large dataset , 2015, Artif. Intell. Medicine.

[23]  Matti Pietikäinen,et al.  HEp-2 Cell Classification: The Role of Gaussian Scale Space Theory as A Pre-processing Approach , 2015, Pattern Recognit. Lett..

[24]  Shijian Lu,et al.  Accurate HEp-2 cell classification based on Sparse Coding of Superpixels , 2016, Pattern Recognit. Lett..

[25]  P. Schur,et al.  ANA screening: an old test with new recommendations , 2010, Annals of the rheumatic diseases.

[26]  Matti Pietikäinen,et al.  Texture Classification using a Linear Configuration Model based Descriptor , 2011, BMVC.

[27]  Yongkang Wong,et al.  Classification of Human Epithelial type 2 cell indirect immunofluoresence images via codebook based descriptors , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[28]  Hossein Rabbani,et al.  Analyzing features by SWLDA for the classification of HEp-2 cell images using GMM , 2016, Pattern Recognit. Lett..

[29]  Matti Pietikäinen,et al.  LOAD: Local orientation adaptive descriptor for texture and material classification , 2015, Neurocomputing.

[30]  Dimitris Kastaniotis,et al.  HEp-2 Cells classification via fusion of morphological and textural features , 2012, 2012 IEEE 12th International Conference on Bioinformatics & Bioengineering (BIBE).

[31]  Mario Vento,et al.  Classifying Anti-nuclear Antibodies HEp-2 Images: A Benchmarking Platform , 2014, 2014 22nd International Conference on Pattern Recognition.

[32]  Mario Vento,et al.  Benchmarking HEp-2 Cells Classification Methods , 2013, IEEE Transactions on Medical Imaging.

[33]  Stephen J. McKenna,et al.  HEp-2 Specimen Classification Using Multi-resolution Local Patterns and SVM , 2014 .

[34]  Fredrik Kahl,et al.  HEp-2 staining pattern classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[35]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[36]  Paul W. Fieguth,et al.  Extended local binary patterns for texture classification , 2012, Image Vis. Comput..