Localizing landmark sets in head CTs using random forests and a heuristic search algorithm for registration initialization

Abstract. Cochlear implants (CIs) use electrode arrays that are surgically inserted into the cochlea to stimulate frequency-mapped nerve endings to treat patients with hearing loss. CIs are programmed postoperatively by audiologists using behavioral tests without information on electrode–cochlea spatial relationship. We have recently developed techniques to segment the intracochlear anatomy and to localize individual contacts in clinically acquired computed tomography (CT) images. Using this information, we have proposed a programming strategy that we call image-guided CI programming (IGCIP), and we have shown that it significantly improves outcomes for both adult and pediatric recipients. One obstacle to large-scale deployment of this technique is the need for manual intervention in some processing steps. One of these is the rough registration of images prior to the use of automated intensity-based algorithms. Although seemingly simple, the heterogeneity of our image set makes this task challenging. We propose a solution that relies on the automated random forest-based localization of multiple landmarks used to estimate an initial transformation with a point-based registration method. Results show that it produces results that are equivalent to a manual initialization. This work is an important step toward the full automation of IGCIP.

[1]  Benoit M. Dawant,et al.  The adaptive bases algorithm for intensity-based nonrigid image registration , 2003, IEEE Transactions on Medical Imaging.

[2]  Benoit M Dawant,et al.  Automatic localization of closely spaced cochlear implant electrode arrays in clinical CTs , 2018, Medical physics.

[3]  Benoit M. Dawant,et al.  Automatic Localization of the Anterior Commissure, Posterior Commissure, and Midsagittal Plane in MRI Scans using Regression Forests , 2015, IEEE Journal of Biomedical and Health Informatics.

[4]  Antonio Criminisi,et al.  Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences , 2011, MICCAI.

[5]  Benoit M. Dawant,et al.  Automatic localization of cochlear implant electrodes in CTs with a limited intensity range , 2014, Medical Imaging.

[6]  Benoit M. Dawant,et al.  Automatic Graph-Based Localization of Cochlear Implant Electrodes in CT , 2015, MICCAI.

[7]  Günther Platsch,et al.  Improved Anatomical Landmark Localization in Medical Images Using Dense Matching of Graphical Models , 2010, BMVC.

[8]  J. Stuelpnagel,et al.  A Least Squares Estimate of Satellite Attitude (Grace Wahba) , 1966 .

[9]  Jay B. West,et al.  Predicting error in rigid-body point-based registration , 1998, IEEE Transactions on Medical Imaging.

[10]  Benoit M Dawant,et al.  Initial Results With Image-guided Cochlear Implant Programming in Children , 2016, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[11]  Benoit M. Dawant,et al.  Image-Guidance Enables New Methods for Customizing Cochlear Implant Stimulation Strategies , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Benoit M. Dawant,et al.  Multi-modal learning-based pre-operative targeting in deep brain stimulation procedures , 2016, 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[13]  Benoit M. Dawant,et al.  Automatic segmentation of intra-cochlear anatomy in post-implantation CT of unilateral cochlear implant recipients , 2014, Medical Image Anal..

[14]  Benoit M. Dawant,et al.  Automatic Localization of Cochlear Implant Electrodes in CT , 2014, MICCAI.

[15]  G. Wahba A Least Squares Estimate of Satellite Attitude , 1965 .

[16]  Gernot Brockmann,et al.  Automatic Aorta Segmentation and Valve Landmark Detection in C-Arm CT for Transcatheter Aortic Valve Implantation , 2012, IEEE Transactions on Medical Imaging.

[17]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[18]  Horst Bischof,et al.  Global localization of 3D anatomical structures by pre-filtered Hough Forests and discrete optimization , 2013, Medical Image Anal..

[19]  Antonio Criminisi,et al.  Regression forests for efficient anatomy detection and localization in computed tomography scans , 2013, Medical Image Anal..

[20]  Benoit M. Dawant,et al.  An artifact-robust, shape library-based algorithm for automatic segmentation of inner ear anatomy in post-cochlear-implantation CT , 2014, Medical Imaging.

[21]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[22]  Omid Majdani,et al.  Automatic Segmentation of Intracochlear Anatomy in Conventional CT , 2011, IEEE Transactions on Biomedical Engineering.

[23]  Benoit M. Dawant,et al.  Clinical Evaluation of an Image-Guided Cochlear Implant Programming Strategy , 2014, Audiology and Neurotology.

[24]  Ching-Wei Wang,et al.  Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral Cephalograms , 2016, Scientific Reports.

[25]  Mohammad A. Dabbah,et al.  Detection and location of 127 anatomical landmarks in diverse CT datasets , 2014, Medical Imaging.

[26]  Yaozong Gao,et al.  Robust anatomical landmark detection with application to MR brain image registration , 2015, Comput. Medical Imaging Graph..