DEEPACC:Automate Chromosome Classification Based On Metaphase Images Using Deep Learning Framework Fused With Priori Knowledge

Chromosome classification is an important but difficult and tedious task in karyotyping. Previous methods only classify manually segmented single chromosome, which is far from clinical practice. In this work, we propose a detection based method, DeepACC, to locate and fine classify chromosomes simultaneously based on the whole metaphase image. We firstly introduce the Additive Angular Margin Loss to enhance the discriminative power of the model. To alleviate batch effects, we transform decision boundary of each class case-by-case through a siamese network which make full use of priori knowledges that chromosomes usually appear in pairs. Furthermore, we take the clinically seven group criteria as a prior-knowledge and design an additional Group Inner-Adjacency Loss to further reduce inter-class similarities. A private metaphase image dataset from clinical laboratory are collected and labelled to evaluate the performance. Results show that the new design brings encouraging performance gains comparing to the state-of-the-art baseline models.

[1]  Bhiksha Raj,et al.  SphereFace: Deep Hypersphere Embedding for Face Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Stefanos Zafeiriou,et al.  ArcFace: Additive Angular Margin Loss for Deep Face Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  C. E. Ford,et al.  A proposed standard system of nomenclature of human mitotic chromosomes. , 1960, The Eugenics review.

[4]  Kai Chen,et al.  MMDetection: Open MMLab Detection Toolbox and Benchmark , 2019, ArXiv.

[5]  Jian Cheng,et al.  NormFace: L2 Hypersphere Embedding for Face Verification , 2017, ACM Multimedia.

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Guang-Zhong Yang,et al.  Varifocal-Net: A Chromosome Classification Approach Using Deep Convolutional Networks , 2018, IEEE Transactions on Medical Imaging.

[9]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[10]  David Patterson,et al.  Molecular genetic analysis of Down syndrome , 2009, Human Genetics.

[11]  L E NIJENHIUS The London Conference on ‘ The Normal Human Karyotype’ * , 1964, American journal of human genetics.

[12]  Yufan Luo,et al.  DeepACEv2: Automated Chromosome Enumeration in Metaphase Cell Images Using Deep Convolutional Neural Networks , 2019, IEEE Transactions on Medical Imaging.

[13]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Lovekesh Vig,et al.  Crowdsourcing for Chromosome Segmentation and Deep Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Lovekesh Vig,et al.  Siamese Networks for Chromosome Classification , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[16]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[17]  Jie Qiao,et al.  DeepACE: Automated Chromosome Enumeration in Metaphase Cell Images Using Deep Convolutional Neural Networks , 2019, MICCAI.

[18]  Hugues Benoit-Cattin,et al.  Removing segmentation inconsistencies with semi-supervised non-adjacency constraint , 2019, Medical Image Anal..

[19]  Jinwen Tian,et al.  Automatic Pattern Extraction and Classification for Chromosome Images , 2010 .

[20]  Revathy Nair Karyotyping Techniques of Chromosomes: A Survey , 2015 .

[21]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[22]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Xing Ji,et al.  CosFace: Large Margin Cosine Loss for Deep Face Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.