Automatic Localization of the Anterior Commissure, Posterior Commissure, and Midsagittal Plane in MRI Scans using Regression Forests

Localizing the anterior and posterior commissures (AC/PC) and the midsagittal plane (MSP) is crucial in stereotactic and functional neurosurgery, human brain mapping, and medical image processing. We present a learning-based method for automatic and efficient localization of these landmarks and the plane using regression forests. Given a point in an image, we first extract a set of multiscale long-range contextual features. We then build random forests models to learn a nonlinear relationship between these features and the probability of the point being a landmark or in the plane. Three-stage coarse-to-fine models are trained for the AC, PC, and MSP separately using downsampled by 4, downsampled by 2, and the original images. Localization is performed hierarchically, starting with a rough estimation that is progressively refined. We evaluate our method using a leave-one-out approach with 100 clinical T1-weighted images and compare it to state-of-the-art methods including an atlas-based approach with six nonrigid registration algorithms and a model-based approach for the AC and PC, and a global symmetry-based approach for the MSP. Our method results in an overall error of 0.55 ± 0.30 mm for AC, 0.56 ± 0.28 mm for PC, 1.08 ± 0.66 in the plane's normal direction, and 1.22 ± 0.73 voxels in average distance for MSP; it performs significantly better than four registration algorithms and the model-based method for AC and PC, and the global symmetry-based method for MSP. We also evaluate the sensitivity of our method to image quality and parameter values. We show that it is robust to asymmetry, noise, and rotation. Computation time is 25 s.

[1]  Benoit M. Dawant,et al.  The adaptive bases algorithm for intensity-based nonrigid image registration , 2003, IEEE Transactions on Medical Imaging.

[2]  P. Gates,et al.  Duus’ Topical Diagnosis in Neurology: Anatomy, Physiology, Signs, Symptoms, 4th edition ‐ By M. Baehr and M. Frotscher , 2006 .

[3]  Alexandre X. Falcão,et al.  Fast and Robust Mid-Sagittal Plane Location in 3D MR Images of the Brain , 2008, BIOSIGNALS.

[4]  Sébastien Ourselin,et al.  Fast free-form deformation using graphics processing units , 2010, Comput. Methods Programs Biomed..

[5]  Hyun Wook Park,et al.  Automatic brain MR image registration based on Talairach reference system , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[6]  Shuguo Wang,et al.  Automatic localization of AC and PC landmarks in T2-weighted MR volumetric neuroimages , 2010, The 2010 IEEE International Conference on Information and Automation.

[7]  Ben Glocker,et al.  Automatic Localization and Identification of Vertebrae in Arbitrary Field-of-View CT Scans , 2012, MICCAI.

[8]  Zhaoying Han,et al.  Effect of non-rigid registration algorithms on the analysis of brain MR images with deformation based morphometry , 2011 .

[9]  Mohammad A. Dabbah,et al.  Detection and location of 127 anatomical landmarks in diverse CT datasets , 2014, Medical Imaging.

[10]  Libero Verard,et al.  Fully automatic identification of AC and PC landmarks on brain MRI using scene analysis , 1997, IEEE Transactions on Medical Imaging.

[11]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  J. A. Noble,et al.  Investigation of the Role of Feature Selection and Weighted Voting in Random Forests for 3-D Volumetric Segmentation , 2014, IEEE Transactions on Medical Imaging.

[13]  David Goldblatt,et al.  Topical Diagnosis in Neurology: Anatomy, Physiology, Signs, Symptoms , 1991 .

[14]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[15]  Yanxi Li,et al.  Truly 3D midsagittal plane extraction for robust neuroimage registration , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[17]  Yanxi Liu,et al.  Robust midsagittal plane extraction from normal and pathological 3-D neuroradiology images , 2001, IEEE Transactions on Medical Imaging.

[18]  Zhong Ming,et al.  Midsagittal plane extraction from brain images based on 3D SIFT. , 2014, Physics in medicine and biology.

[19]  Babak A. Ardekani,et al.  Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans , 2005, Journal of Neuroscience Methods.

[20]  Yanxi Liu,et al.  A new symmetry-based method for mid-sagittal plane extraction in neuroimages , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[21]  Aamer Aziz,et al.  Rapid and automatic localization of the anterior and posterior commissure point landmarks in MR volumetric neuroimages. , 2006, Academic radiology.

[22]  Timothy F. Cootes,et al.  Fully Automatic Segmentation of the Proximal Femur Using Random Forest Regression Voting , 2013, IEEE Transactions on Medical Imaging.

[23]  Alexander G. Schwing,et al.  Reliable extraction of the mid-sagittal plane in 3D brain MRI via hierarchical landmark detection , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[24]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[25]  D. Collins,et al.  Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space , 1994, Journal of computer assisted tomography.

[26]  Peter Lorenzen,et al.  Structural and radiometric asymmetry in brain images , 2003, Medical Image Anal..

[27]  Philip A. Starr,et al.  Placement of Deep Brain Stimulators into the Subthalamic Nucleus or Globus pallidus internus: Technical Approach , 2003, Stereotactic and Functional Neurosurgery.

[28]  M E Brummer,et al.  Hough transform detection of the longitudinal fissure in tomographic head images. , 1991, IEEE transactions on medical imaging.

[29]  Antonio Criminisi,et al.  Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences , 2011, MICCAI.

[30]  Babak A. Ardekani,et al.  Model-based automatic detection of the anterior and posterior commissures on MRI scans , 2009, NeuroImage.

[31]  Wieslaw Lucjan Nowinski,et al.  Extraction of the midsagittal plane from morphological neuroimages using the Kullback-Leibler's measure , 2006, Medical Image Anal..

[32]  Aaron Carass,et al.  Automatic estimation of midsagittal plane and AC-PC alignment on nonrigid registration , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[33]  Benoit M. Dawant,et al.  Effects of deformable registration algorithms on the creation of statistical maps for preoperative targeting in deep brain stimulation procedures , 2014, Medical Imaging.

[34]  Wieslaw Lucjan Nowinski,et al.  Atlas-assisted localization analysis of functional images , 2001, Medical Image Anal..

[35]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[36]  Wieslaw L. Nowinski,et al.  A rapid algorithm for robust and automatic extraction of the midsagittal plane of the human cerebrum from neuroimages based on local symmetry and outlier removal , 2003, NeuroImage.

[37]  J. Alison Noble,et al.  A Constrained Regression Forests Solution to 3D Fetal Ultrasound Plane Localization for Longitudinal Analysis of Brain Growth and Maturation , 2014, MLMI.

[38]  Benoit M. Dawant,et al.  Automated selection of anterior and posterior commissures based on a deformable atlas and its evaluation based on manual selections by neurosurgeons , 2007, SPIE Medical Imaging.

[39]  Benoit M. Dawant,et al.  CranialVault and its CRAVE tools: A clinical computer assistance system for deep brain stimulation (DBS) therapy , 2012, Medical Image Anal..

[40]  G. Schaltenbrand,et al.  Atlas for Stereotaxy of the Human Brain , 1977 .

[41]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[42]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[43]  Iwao Kanno,et al.  Automatic detection of the mid-sagittal plane in 3-D brain images , 1997, IEEE Transactions on Medical Imaging.

[44]  A. Toga,et al.  Mapping brain asymmetry , 2003, Nature Reviews Neuroscience.

[45]  Benoit M. Dawant,et al.  Intersurgeon Variability in the Selection of Anterior and Posterior Commissures and Its Potential Effects on Target Localization , 2008, Stereotactic and Functional Neurosurgery.

[46]  Benoit M. Dawant,et al.  Automatic detection of the anterior and posterior commissures on MRI scans using regression forests , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[47]  Benoit M. Dawant,et al.  Validation of a Fully Automatic Method for the Routine Selection of the Anterior and Posterior Commissures in Magnetic Resonance Images , 2009, Stereotactic and Functional Neurosurgery.

[48]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.