Robust Automatic Multiple Landmark Detection

Reinforcement learning (RL) has proven to be a powerful tool for automatic single landmark detection in 3D medical images. In this work, we extend RL-based single landmark detection to detect multiple landmarks simultaneously in the presence of missing data in the form of defaced 3D head MR images. Our purposed technique is both time-efficient and robust to missing data. We demonstrate that adding auxiliary landmarks can improve the accuracy and robustness of estimating primary target landmark locations. The multi-agent deep Q-network (DQN) approach described here detects landmarks within 2mm, even in the presence of missing data.

[1]  Gregory G. Brown,et al.  A technique for the deidentification of structural brain MR images , 2007, Human brain mapping.

[2]  Dorin Comaniciu,et al.  Robust Multi-scale Anatomical Landmark Detection in Incomplete 3D-CT Data , 2017, MICCAI.

[3]  Hans J. Johnson,et al.  Robust automated constellation-based landmark detection in human brain imaging , 2017, NeuroImage.

[4]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[5]  Hamid R. Tizhoosh,et al.  A Reinforcement Learning Framework for Medical Image Segmentation , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[6]  Daniel S. Marcus,et al.  Obscuring Surface Anatomy in Volumetric Imaging Data , 2012, Neuroinformatics.

[7]  Dorin Comaniciu,et al.  An Artificial Agent for Anatomical Landmark Detection in Medical Images , 2016, MICCAI.

[8]  John Hale,et al.  Quickshear Defacing for Neuroimages , 2011, HealthSec.

[9]  Dorin Comaniciu,et al.  Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Gustavo Carneiro,et al.  Deep Reinforcement Learning for Active Breast Lesion Detection from DCE-MRI , 2017, MICCAI.

[11]  Loïc Le Folgoc,et al.  Evaluating reinforcement learning agents for anatomical landmark detection , 2019, Medical Image Anal..

[12]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.