Training echo state networks for rotation-invariant bone marrow cell classification

The main principle of diagnostic pathology is the reliable interpretation of individual cells in context of the tissue architecture. Especially a confident examination of bone marrow specimen is dependent on a valid classification of myeloid cells. In this work, we propose a novel rotation-invariant learning scheme for multi-class echo state networks (ESNs), which achieves very high performance in automated bone marrow cell classification. Based on representing static images as temporal sequence of rotations, we show how ESNs robustly recognize cells of arbitrary rotations by taking advantage of their short-term memory capacity. The performance of our approach is compared to a classification random forest that learns rotation-invariance in a conventional way by exhaustively training on multiple rotations of individual samples. The methods were evaluated on a human bone marrow image database consisting of granulopoietic and erythropoietic cells in different maturation stages. Our ESN approach to cell classification does not rely on segmentation of cells or manual feature extraction and can therefore directly be applied to image data.

[1]  Qing Zheng,et al.  Direct neural network application for automated cell recognition , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[2]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[3]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[4]  E. Micheli-Tzanakou,et al.  Neural Networks and Blood Cell Identification , 1997, Journal of Medical Systems.

[5]  Peter Rossmanith,et al.  Simulated Annealing , 2008, Taschenbuch der Algorithmen.

[6]  Nipon Theera-Umpon,et al.  Morphological Granulometric Features of Nucleus in Automatic Bone Marrow White Blood Cell Classification , 2007, IEEE Transactions on Information Technology in Biomedicine.

[7]  S. Beksac,et al.  Feature extraction and classification of blood cells for an automated differential blood count system , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[8]  Xiaowei Xu,et al.  Investigating drug repositioning opportunities in FDA drug labels through topic modeling , 2012, BMC Bioinformatics.

[9]  Samir I. Shaheen,et al.  Segmentation and classification of white blood cells , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[10]  Paul D. Gader,et al.  Training neural networks to count white blood cells via a minimum counting error objective function , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[11]  Adnan Khashman IBCIS: Intelligent blood cell identification system , 2008 .

[12]  Kathryn A. Dowsland,et al.  Simulated Annealing , 1989, Encyclopedia of GIS.

[13]  Yongwei Zhang,et al.  A new method for automatic counting of marrow cells , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[14]  Mantas Lukosevicius,et al.  A Practical Guide to Applying Echo State Networks , 2012, Neural Networks: Tricks of the Trade.

[15]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[16]  Selim Aksoy,et al.  Unsupervised segmentation and classification of cervical cell images , 2012, Pattern Recognit..

[17]  P J Sjöström,et al.  Artificial neural network-aided image analysis system for cell counting. , 1999, Cytometry.

[18]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[19]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[20]  Rong-Ming Chen,et al.  Blood Cell Image Classification Based on Hierarchical SVM , 2011, 2011 IEEE International Symposium on Multimedia.

[21]  S. Osowski,et al.  Automatic recognition of the blood cells of myelogenous leukemia using SVM , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[22]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Benjamin Schrauwen,et al.  Memory versus non-linearity in reservoirs , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[24]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[25]  Domenico Tegolo,et al.  An automated image analysis methodology for classifying megakaryocytes in chronic myeloproliferative disorders , 2008, Medical Image Anal..

[26]  Mark H. Ellisman,et al.  Method: automatic segmentation of mitochondria utilizing patch classification, contour pair classification, and automatically seeded level sets , 2012, BMC Bioinformatics.

[27]  Vincent Lepetit,et al.  You Should Use Regression to Detect Cells , 2015, MICCAI.

[28]  Andrew Blake,et al.  Random Forest Classification for Automatic Delineation of Myocardium in Real-Time 3D Echocardiography , 2009, FIMH.

[29]  Duncan Fyfe Gillies,et al.  Patch forest: a hybrid framework of random forest and patch-based segmentation , 2016, SPIE Medical Imaging.

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  Jesus A. Gonzalez,et al.  Segmentation and Classification of Bone Marrow Cells Images Using Contextual Information for Medical Diagnosis of Acute Leukemias , 2015, PloS one.

[32]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[33]  Takashi Ikegami,et al.  A Reservoir Computing approach to Image Classification using Coupled Echo State and BackPropagation Neural Networks , 2011 .

[34]  E. Micheli-Tzanakou,et al.  A computational intelligence system for cell classification , 1998, Proceedings. 1998 IEEE International Conference on Information Technology Applications in Biomedicine, ITAB '98 (Cat. No.98EX188).

[35]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[36]  Chang H. Kim Homeostatic and pathogenic extramedullary hematopoiesis , 2010 .

[37]  Nipon Theera-Umpon,et al.  White Blood Cell Segmentation and Classification in Microscopic Bone Marrow Images , 2005, FSKD.

[38]  K. Thilagavathi,et al.  Automatic red blood cell counting using hough transform , 2013, 2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES.

[39]  Luciano da Fontoura Costa,et al.  Toward leukocyte recognition using morphometry, texture and color , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[40]  Shaimaa Al-Janabi,et al.  Digital pathology: current status and future perspectives , 2012, Histopathology.

[41]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[42]  Jochen J. Steil,et al.  Online reservoir adaptation by intrinsic plasticity for backpropagation-decorrelation and echo state learning , 2007, Neural Networks.

[43]  Dipti Patra,et al.  An ensemble classifier system for early diagnosis of acute lymphoblastic leukemia in blood microscopic images , 2013, Neural Computing and Applications.

[44]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[45]  Tolga Tasdizen,et al.  Isolation and two-step classification of normal white blood cells in peripheral blood smears , 2012, Journal of pathology informatics.

[46]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[47]  Madhukar C. Pandit,et al.  Analysis of blood and bone marrow smears using digital image processing techniques , 2002, SPIE Medical Imaging.

[48]  A. Krzyżak,et al.  White Blood Cell Differential Counts Using Convolutional Neural Networks for Low Resolution Images , 2013, ICAISC.

[49]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[50]  Harald Burgsteiner,et al.  Robust Bone Marrow Cell Discrimination by Rotation-Invariant Training of Multi-class Echo State Networks , 2015, EANN.

[51]  Antonio Criminisi,et al.  Decision Forests for Computer Vision and Medical Image Analysis , 2013, Advances in Computer Vision and Pattern Recognition.

[52]  Shitong Wang,et al.  A new detection algorithm (NDA) based on fuzzy cellular neural networks for white blood cell detection , 2006, IEEE Transactions on Information Technology in Biomedicine.

[53]  Analysis of leukemia development based on marrow cell images , 2011, 2011 4th International Congress on Image and Signal Processing.

[54]  Stanislaw Osowski,et al.  Comparative Analysis of Feature Selection Methods for Blood Cell Recognition in Leukemia , 2012, MLDM.

[55]  F. Scotti,et al.  Automatic morphological analysis for acute leukemia identification in peripheral blood microscope images , 2005, CIMSA. 2005 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications, 2005..

[56]  Hugo Jair Escalante,et al.  Acute leukemia classification by ensemble particle swarm model selection , 2012, Artif. Intell. Medicine.

[57]  Yan Zhang,et al.  Analysis of blood and bone marrow smears using multispectral imaging analysis techniques , 2005, SPIE Medical Imaging.

[58]  H. Ramoser,et al.  Leukocyte segmentation and classification in blood-smear images , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[59]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.