Anatomical Landmark Detection using Deep Appearance-Context Network

Accurate identification of anatomical landmarks is a crucial step in medical image analysis. While deep neural networks have shown impressive performance on computer vision tasks, they rely on a large amount of data, which is often not available. In this work, we propose an attention-driven end-to-end deep learning architecture, which learns the local appearance and global context separately that helps in stable training under limited data. The experiments conducted demonstrate the effectiveness of the proposed approach with impressive results in localizing landmarks when evaluated on cephalometric and spine X-ray image data. The predicted landmarks are further utilized in biomedical applications to demonstrate the impact.

[1]  Huiqi Li,et al.  Automatic Analysis of Lateral Cephalograms Based on Multiresolution Decision Tree Regression Voting , 2018, Journal of healthcare engineering.

[2]  Liansheng Wang,et al.  An Automated and Accurate Spine Curve Analysis System , 2019, IEEE Access.

[3]  Timothy F. Cootes,et al.  Fully Automatic Cephalometric Evaluation using Random Forest Regression-Voting , 2015, ISBI 2015.

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Nathan Lay,et al.  Rapid Multi-organ Segmentation Using Context Integration and Discriminative Models , 2013, IPMI.

[6]  Antonio Albiol,et al.  Face recognition using HOG-EBGM , 2008, Pattern Recognit. Lett..

[7]  Shuo Li,et al.  Automatic Landmark Estimation for Adolescent Idiopathic Scoliosis Assessment Using BoostNet , 2017, MICCAI.

[8]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[9]  Jonathan Tompson,et al.  Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation , 2014, NIPS.

[10]  Wenping Wang,et al.  Cephalometric Landmark Detection by AttentiveFeature Pyramid Fusion and Regression-Voting , 2019, MICCAI.

[11]  Thomas Lange,et al.  3D ultrasound-CT registration of the liver using combined landmark-intensity information , 2008, International Journal of Computer Assisted Radiology and Surgery.

[12]  Rosalia Leonardi,et al.  Landmark identification error in posteroanterior cephalometric radiography. A systematic review. , 2008, The Angle orthodontist.

[13]  Bulat Ibragimov,et al.  Computerized Cephalometry by Game Theory with Shape-and Appearance-Based Landmark Refinement , 2016 .

[14]  Jin Keun Seo,et al.  Automation of Spine Curve Assessment in Frontal Radiographs Using Deep Learning of Vertebral-Tilt Vector , 2020, IEEE Access.

[15]  Timothy F. Cootes,et al.  A benchmark for comparison of dental radiography analysis algorithms , 2016, Medical Image Anal..

[16]  Christian Payer,et al.  Integrating spatial configuration into heatmap regression based CNNs for landmark localization , 2019, Medical Image Anal..

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Martin Urschler,et al.  Integrating geometric configuration and appearance information into a unified framework for anatomical landmark localization , 2018, Medical Image Anal..

[19]  Bishesh Khanal,et al.  Automatic Cobb Angle Detection using Vertebra Detector and Vertebra Corners Regression , 2019, CSI@MICCAI.