Extended ResNet and Label Feature Vector Based Chromosome Classification

Human chromosome classification is essential to the clinical diagnosis of cytogenetical diseases such as genetic disorders and cancer. This process, however, is time-consuming and requires specialist knowledge. Considerable efforts have been made to automat the process. Recently, methods based on Convolutional Neural Networks achieved state-of-the-art results on the chromosome classification task. Many studies used karyotype images in performance evaluation, few studies have reported the results of human chromosome classification on microscopical images. This paper proposes a novel method to classify single chromosome images into one of 24 types. In the proposed method an extended ResNet was first devised to extract features of single chromosome images. A label feature vector was then extracted for each of 24 chromosome types based on a validation dataset. Hausdorff distance between feature vector of an input image and each of 24 label feature vectors were calculated, and the label feature vector that has minimum hausdorff distance to the feature vector of the input image was selected as the potential label of the input image. To finally allocate the single chromosomes from a same microscopical image into one of 24 types, a Label Redistribution strategy was used to shrink the label space and to increase the efficiency of chromosome classification. Experiments were implemented with 90,624 single chromosome images, 644 of which were randomly picked to form a testing set in advance. The classification accuracy on microscopical images using our proposed method achieved an accuracy of 94.72%.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Allan Hanbury,et al.  An Efficient Algorithm for Calculating the Exact Hausdorff Distance , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[4]  Trevor Darrell,et al.  Learning to Segment Every Thing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[6]  Lovekesh Vig,et al.  Siamese Networks for Chromosome Classification , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[7]  Jionglong Su,et al.  Chromosome Classification with Convolutional Neural Network Based Deep Learning , 2018, 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[8]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[9]  Morag Park,et al.  What is a chromosome? , 1991, The Journal of pathology.

[10]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  P Gader,et al.  Automatic karyotyping of metaphase cells with overlapping chromosomes , 1999, Comput. Biol. Medicine.

[13]  Boaz Lerner,et al.  Toward a completely automatic neural-network-based human chromosome analysis , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  S. Suresh,et al.  Analysis of human chromosome images: Application towards an automated chromosome classification , 2018, Int. J. Imaging Syst. Technol..

[16]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Yongchao Gong,et al.  Mask Scoring R-CNN , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[19]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[21]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[22]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Yan Zhang,et al.  Classification of Metaphase Chromosomes Using Deep Convolutional Neural Network , 2019, J. Comput. Biol..

[24]  Its'hak Dinstein,et al.  Feature selection and learning curves of a multilayer perceptron chromosome classifier , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[25]  D. Banerjee,et al.  Impact of chromosome alterations, genetic mutations and clonal hematopoiesis of indeterminate potential (CHIP) on the classification and risk stratification of MDS. , 2017, Blood cells, molecules & diseases.

[26]  Seyed Kamaledin Setarehdan,et al.  New features for automatic classification of human chromosomes: A feasibility study , 2006, Pattern Recognit. Lett..

[27]  S. Suresh,et al.  Contour based segmentation of chromosomes in G-band metaphase images , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[28]  Guang-Zhong Yang,et al.  Varifocal-Net: A Chromosome Classification Approach Using Deep Convolutional Networks , 2018, IEEE Transactions on Medical Imaging.

[29]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[31]  Shengcai Liao,et al.  Deep Metric Learning for Person Re-identification , 2014, 2014 22nd International Conference on Pattern Recognition.

[32]  Kaiming He,et al.  Panoptic Feature Pyramid Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Lovekesh Vig,et al.  Automatic Chromosome Classification using Deep Attention Based Sequence Learning of Chromosome Bands , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[34]  Yan Zhang,et al.  Down syndrome prediction/screening model based on deep learning and illumina genotyping array , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[35]  Latifa Hamami,et al.  A survey of neural network based automated systems for human chromosome classification , 2016, Artificial Intelligence Review.