One-Shot Medical Landmark Detection

The success of deep learning methods relies on the availability of a large number of datasets with annotations; however, curating such datasets is burdensome, especially for medical images. To relieve such a burden for a landmark detection task, we explore the feasibility of using only a single annotated image and propose a novel framework named Cascade Comparing to Detect (CC2D) for one-shot landmark detection. CC2D consists of two stages: 1) Self-supervised learning (CC2D-SSL) and 2) Training with pseudo-labels (CC2D-TPL). CC2DSSL captures the consistent anatomical information in a coarse-to-fine fashion by comparing the cascade feature representations and generates predictions on the training set. CC2D-TPL further improves the performance by training a new landmark detector with those predictions. The effectiveness of CC2D is evaluated on a widely-used public dataset of cephalometric landmark detection, which achieves a competitive detection accuracy of 81.01% within 4.0mm, comparable to the state-of-the-art fully-supervised methods using a lot more than one training image.

[1]  Ender Konukoglu,et al.  Contrastive learning of global and local features for medical image segmentation with limited annotations , 2020, NeurIPS.

[2]  Yoshua Bengio,et al.  A Closer Look at Memorization in Deep Networks , 2017, ICML.

[3]  Nassir Navab,et al.  X-ray-transform Invariant Anatomical Landmark Detection for Pelvic Trauma Surgery , 2018, MICCAI.

[4]  Ching-Wei Wang,et al.  Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral Cephalograms , 2016, Scientific Reports.

[5]  Wenping Wang,et al.  Cephalometric Landmark Detection by AttentiveFeature Pyramid Fusion and Regression-Voting , 2019, MICCAI.

[6]  S. Kevin Zhou,et al.  Bounding Maps for Universal Lesion Detection , 2020, MICCAI.

[7]  Christian Payer,et al.  Integrating spatial configuration into heatmap regression based CNNs for landmark localization , 2019, Medical Image Anal..

[8]  Bulat Ibragimov,et al.  Computerized Cephalometry by Game Theory with Shape-and Appearance-Based Landmark Refinement , 2016 .

[9]  Kai Ma,et al.  Rubik's Cube+: A self-supervised feature learning framework for 3D medical image analysis , 2020, Medical Image Anal..

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Zongwei Zhou,et al.  Models Genesis , 2020, Medical Image Anal..

[12]  Lei Zhang,et al.  Landmarks Detection with Anatomical Constraints for Total Hip Arthroplasty Preoperative Measurements , 2020, MICCAI.

[13]  Sotirios A. Tsaftaris,et al.  Medical Image Computing and Computer Assisted Intervention , 2017 .

[14]  Timothy F. Cootes,et al.  Fully Automatic Cephalometric Evaluation using Random Forest Regression-Voting , 2015, ISBI 2015.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Chunfeng Lian,et al.  Automatic Localization of Landmarks in Craniomaxillofacial CBCT Images Using a Local Attention-Based Graph Convolution Network , 2020, MICCAI.

[17]  Riddhish Bhalodia,et al.  Self-Supervised Discovery of Anatomical Shape Landmarks , 2020, MICCAI.

[18]  Nima Tajbakhsh,et al.  Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysis , 2019, MICCAI.

[19]  D. Rueckert,et al.  Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotation , 2020, ECCV.

[20]  Timothy F. Cootes,et al.  A benchmark for comparison of dental radiography analysis algorithms , 2016, Medical Image Anal..

[21]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[22]  Dorin Comaniciu,et al.  Search strategies for multiple landmark detection by submodular maximization , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Shuang Yu,et al.  Comparing to Learn: Surpassing ImageNet Pretraining on Radiographs By Comparing Image Representations , 2020, MICCAI.

[24]  Martin Urschler,et al.  Integrating geometric configuration and appearance information into a unified framework for anatomical landmark localization , 2018, Medical Image Anal..

[25]  S. Kevin Zhou,et al.  Miss the Point: Targeted Adversarial Attack on Multiple Landmark Detection , 2020, MICCAI.

[26]  Horst Bischof,et al.  Regressing Heatmaps for Multiple Landmark Localization Using CNNs , 2016, MICCAI.

[27]  Daguang Xu,et al.  Automatic Vertebra Labeling in Large-Scale 3D CT using Deep Image-to-Image Network with Message Passing and Sparsity Regularization , 2017, IPMI.

[28]  H. K. Huang,et al.  Bone age assessment of children using a digital hand atlas , 2007, Comput. Medical Imaging Graph..

[29]  Ronald M. Summers,et al.  A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies With Progress Highlights, and Future Promises , 2020, Proceedings of the IEEE.

[30]  Dorin Comaniciu,et al.  3D Deep Learning for Efficient and Robust Landmark Detection in Volumetric Data , 2015, MICCAI.

[31]  Jie Li,et al.  An Attention-Guided Deep Regression Model for Landmark Detection in Cephalograms , 2019, MICCAI.

[32]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[33]  Dimitris N. Metaxas,et al.  Automated anatomical landmark detection ondistal femur surface using convolutional neural network , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[34]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.