The Development of a Practical Artificial Intelligence Tool for Diagnosing and Evaluating Autism Spectrum Disorder: Multicenter Study

Background Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder with an unknown etiology. Early diagnosis and intervention are key to improving outcomes for patients with ASD. Structural magnetic resonance imaging (sMRI) has been widely used in clinics to facilitate the diagnosis of brain diseases such as brain tumors. However, sMRI is less frequently used to investigate neurological and psychiatric disorders, such as ASD, owing to the subtle, if any, anatomical changes of the brain. Objective This study aimed to investigate the possibility of identifying structural patterns in the brain of patients with ASD as potential biomarkers in the diagnosis and evaluation of ASD in clinics. Methods We developed a novel 2-level histogram-based morphometry (HBM) classification framework in which an algorithm based on a 3D version of the histogram of oriented gradients (HOG) was used to extract features from sMRI data. We applied this framework to distinguish patients with ASD from healthy controls using 4 datasets from the second edition of the Autism Brain Imaging Data Exchange, including the ETH Zürich (ETH), NYU Langone Medical Center: Sample 1, Oregon Health and Science University, and Stanford University (SU) sites. We used a stratified 10-fold cross-validation method to evaluate the model performance, and we applied the Naive Bayes approach to identify the predictive ASD-related brain regions based on classification contributions of each HOG feature. Results On the basis of the 3D HOG feature extraction method, our proposed HBM framework achieved an area under the curve (AUC) of >0.75 in each dataset, with the highest AUC of 0.849 in the ETH site. We compared the 3D HOG algorithm with the original 2D HOG algorithm, which showed an accuracy improvement of >4% in each dataset, with the highest improvement of 14% (6/42) in the SU site. A comparison of the 3D HOG algorithm with the scale-invariant feature transform algorithm showed an AUC improvement of >18% in each dataset. Furthermore, we identified ASD-related brain regions based on the sMRI images. Some of these regions (eg, frontal gyrus, temporal gyrus, cingulate gyrus, postcentral gyrus, precuneus, caudate, and hippocampus) are known to be implicated in ASD in prior neuroimaging literature. We also identified less well-known regions that may play unrecognized roles in ASD and be worth further investigation. Conclusions Our research suggested that it is possible to identify neuroimaging biomarkers that can distinguish patients with ASD from healthy controls based on the more cost-effective sMRI images of the brain. We also demonstrated the potential of applying data-driven artificial intelligence technology in the clinical setting of neurological and psychiatric disorders, which usually harbor subtle anatomical changes in the brain that are often invisible to the human eye.

[1]  Dinggang Shen,et al.  Enhancing the representation of functional connectivity networks by fusing multi‐view information for autism spectrum disorder diagnosis , 2018, Human brain mapping.

[2]  S. Begeer,et al.  Delayed autism spectrum disorder recognition in children and adolescents previously diagnosed with attention-deficit/hyperactivity disorder , 2018, Autism : the international journal of research and practice.

[3]  S. Rose,et al.  A systematic review of structural MRI biomarkers in autism spectrum disorder: A machine learning perspective , 2018, International Journal of Developmental Neuroscience.

[4]  A. Galaburda,et al.  Regional volumetric abnormalities in pediatric autism revealed by structural magnetic resonance imaging , 2018, International Journal of Developmental Neuroscience.

[5]  Christos Davatzikos,et al.  Classification of multi-site MR images in the presence of heterogeneity using multi-task learning☆ , 2018, NeuroImage: Clinical.

[6]  A. Franco,et al.  NeuroImage: Clinical , 2022 .

[7]  Nicha C. Dvornek,et al.  Identifying Autism from Resting-State fMRI Using Long Short-Term Memory Networks , 2017, MLMI@MICCAI.

[8]  Hailong Li,et al.  Diagnosing Autism Spectrum Disorder from Brain Resting-State Functional Connectivity Patterns Using a Deep Neural Network with a Novel Feature Selection Method , 2017, Front. Neurosci..

[9]  Dinggang Shen,et al.  Multi‐task diagnosis for autism spectrum disorders using multi‐modality features: A multi‐center study , 2017, Human brain mapping.

[10]  Daniel P. Kennedy,et al.  Enhancing studies of the connectome in autism using the autism brain imaging data exchange II , 2017, Scientific Data.

[11]  M. Simms When Autistic Behavior Suggests a Disease Other than Classic Autism. , 2017, Pediatric clinics of North America.

[12]  Ahmed Serag,et al.  Histograms of Oriented 3D Gradients for Fully Automated Fetal Brain Localization and Robust Motion Correction in 3 T Magnetic Resonance Images , 2017, BioMed research international.

[13]  Alan C. Evans,et al.  Early brain development in infants at high risk for autism spectrum disorder , 2017, Nature.

[14]  Dimitris Samaras,et al.  Deriving reproducible biomarkers from multi-site resting-state data: An Autism-based example , 2016, NeuroImage.

[15]  Russell Greiner,et al.  Using Functional or Structural Magnetic Resonance Images and Personal Characteristic Data to Identify ADHD and Autism , 2016, PloS one.

[16]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[17]  Nathan D. Cahill,et al.  The predictive power of structural MRI in Autism diagnosis , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  J. Paul Leigh,et al.  Brief Report: Forecasting the Economic Burden of Autism in 2015 and 2025 in the United States , 2015, Journal of autism and developmental disorders.

[19]  Dinggang Shen,et al.  Multiple-Network Classification of Childhood Autism Using Functional Connectivity Dynamics , 2014, MICCAI.

[20]  Kenneth Revett,et al.  Computer-aided diagnosis of human brain tumor through MRI: A survey and a new algorithm , 2014, Expert Syst. Appl..

[21]  Lawrence J. Mazlack,et al.  Detecting brain structural changes as biomarker from magnetic resonance images using a local feature based SVM approach , 2014, Journal of Neuroscience Methods.

[22]  J. Trojanowski,et al.  Integration and relative value of biomarkers for prediction of MCI to AD progression: Spatial patterns of brain atrophy, cognitive scores, APOE genotype and CSF biomarkers , 2013, NeuroImage: Clinical.

[23]  Scott K. Holland,et al.  Combined analysis of sMRI and fMRI imaging data provides accurate disease markers for hearing impairment☆ , 2013, NeuroImage: Clinical.

[24]  Jared A. Nielsen,et al.  Multisite functional connectivity MRI classification of autism: ABIDE results , 2013, Front. Hum. Neurosci..

[25]  Fenna M. Krienen,et al.  Opportunities and limitations of intrinsic functional connectivity MRI , 2013, Nature Neuroscience.

[26]  Francesc Moreno-Noguer,et al.  A Joint Model for 2D and 3D Pose Estimation from a Single Image , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Takumi Kobayashi,et al.  BFO Meets HOG: Feature Extraction Based on Histograms of Oriented p.d.f. Gradients for Image Classification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Do P. M. Tromp,et al.  Diffusion Tensor Imaging in Autism Spectrum Disorder: A Review , 2012, Autism research : official journal of the International Society for Autism Research.

[29]  Yu Shang,et al.  Noninvasive optical evaluation of spontaneous low frequency oscillations in cerebral hemodynamics , 2012, NeuroImage.

[30]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[31]  Mark S. Cohen,et al.  Insights into multimodal imaging classification of ADHD , 2012, Front. Syst. Neurosci..

[32]  U. Rajendra Acharya,et al.  Use of principal component analysis for automatic classification of epileptic EEG activities in wavelet framework , 2012, Expert Syst. Appl..

[33]  Klaus P. Ebmeier,et al.  Multi-centre diagnostic classification of individual structural neuroimaging scans from patients with major depressive disorder. , 2012, Brain : a journal of neurology.

[34]  Daoqiang Zhang,et al.  Ensemble sparse classification of Alzheimer's disease , 2012, NeuroImage.

[35]  Christopher N. Kaufmann,et al.  Co-occurring Conditions and Change in Diagnosis in Autism Spectrum Disorders , 2012, Pediatrics.

[36]  Alessandra Retico,et al.  Female children with autism spectrum disorder: An insight from mass-univariate and pattern classification analyses , 2012, NeuroImage.

[37]  Mohammad Reza Daliri,et al.  Automated Diagnosis of Alzheimer Disease using the Scale-Invariant Feature Transforms in Magnetic Resonance Images , 2012, Journal of Medical Systems.

[38]  Vittorio Murino,et al.  Classification of schizophrenia using feature-based morphometry , 2012, Journal of Neural Transmission.

[39]  Walter Paulus,et al.  Individual voxel‐based subtype prediction can differentiate progressive supranuclear palsy from idiopathic parkinson syndrome and healthy controls , 2011, Human brain mapping.

[40]  Daniel Rueckert,et al.  Random Forest-Based Manifold Learning for Classification of Imaging Data in Dementia , 2011, MLMI.

[41]  Lars Petersson,et al.  Large scale sign detection using HOG feature variants , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[42]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[43]  Marie Chupin,et al.  Automatic classi fi cation of patients with Alzheimer ' s disease from structural MRI : A comparison of ten methods using the ADNI database , 2010 .

[44]  Dimitri Van De Ville,et al.  Decoding brain states from fMRI connectivity graphs , 2011, NeuroImage.

[45]  Christian Keysers,et al.  Age-Related Increase in Inferior Frontal Gyrus Activity and Social Functioning in Autism Spectrum Disorder , 2011, Biological Psychiatry.

[46]  Yun Jiao,et al.  Structural MRI in Autism Spectrum Disorder , 2011, Pediatric Research.

[47]  Christian Keysers,et al.  The impact of certain methodological choices on multivariate analysis of fMRI data with support vector machines , 2011, NeuroImage.

[48]  Ernesto Zacur,et al.  Tensor-based morphometry with stationary velocity field diffeomorphic registration: Application to ADNI , 2010, NeuroImage.

[49]  Hui Cheng,et al.  3D model based vehicle classification in aerial imagery , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[50]  Yun Jiao,et al.  Predictive models of autism spectrum disorder based on brain regional cortical thickness , 2010, NeuroImage.

[51]  D. Louis Collins,et al.  Feature-based morphometry: Discovering group-related anatomical patterns , 2010, NeuroImage.

[52]  Janaina Mourão Miranda,et al.  Investigating the predictive value of whole-brain structural MR scans in autism: A pattern classification approach , 2010, NeuroImage.

[53]  Lucina Q. Uddin,et al.  The anterior insula in autism: Under-connected and under-examined , 2009, Neuroscience & Biobehavioral Reviews.

[54]  Daisuke Yamamoto,et al.  Computer-Aided Diagnosis Systems for Brain Diseases in Magnetic Resonance Images , 2009, Algorithms.

[55]  Cui-Hua Li,et al.  Unifying visual saliency with HOG feature learning for traffic sign detection , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[56]  H. Benali,et al.  Support vector machine-based classification of Alzheimer’s disease from whole-brain anatomical MRI , 2009, Neuroradiology.

[57]  Tieniu Tan,et al.  Estimating the number of people in crowded scenes by MID based foreground segmentation and head-shoulder detection , 2008, 2008 19th International Conference on Pattern Recognition.

[58]  Michael Weiner,et al.  Tensor-based morphometry as a neuroimaging biomarker for Alzheimer's disease: An MRI study of 676 AD, MCI, and normal subjects , 2008, NeuroImage.

[59]  G. Fryer,et al.  Disparities in Diagnosis and Access to Health Services for Children with Autism: Data from the National Survey of Children's Health , 2008, Journal of developmental and behavioral pediatrics : JDBP.

[60]  S. Blakemore The social brain in adolescence , 2008, Nature Reviews Neuroscience.

[61]  D. Amaral,et al.  Neuroanatomy of autism , 2008, Trends in Neurosciences.

[62]  Clifford R. Jack,et al.  Alzheimer's disease diagnosis in individual subjects using structural MR images: Validation studies , 2008, NeuroImage.

[63]  W. McMahon,et al.  Superior Temporal Gyrus, Language Function, and Autism , 2007, Developmental neuropsychology.

[64]  Paul M. Thompson,et al.  3D pattern of brain abnormalities in Fragile X syndrome visualized using tensor-based morphometry , 2007, NeuroImage.

[65]  M. Reite,et al.  Regional gray matter volumetric changes in autism associated with social and repetitive behavior symptoms , 2006, BMC psychiatry.

[66]  Matthew W. Mosconi,et al.  Structural MRI in autism: Findings and future directions , 2006, Clinical Neuroscience Research.

[67]  K. Grill-Spector,et al.  Autism and the development of face processing , 2006, Clinical Neuroscience Research.

[68]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[69]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[70]  David I. Perrett,et al.  Structural white matter deficits in high-functioning individuals with autistic spectrum disorder: a voxel-based investigation , 2005, NeuroImage.

[71]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[72]  Dinggang Shen,et al.  Morphological classification of brains via high-dimensional shape transformations and machine learning methods , 2004, NeuroImage.

[73]  Kurt Hornik,et al.  The support vector machine under test , 2003, Neurocomputing.

[74]  John Suckling,et al.  For personal use. Only reproduce with permission from The Lancet Publishing Group. Effect of sunlight and season on serotonin turnover in the brain , 2002 .

[75]  U. Frith Mind Blindness and the Brain in Autism , 2001, Neuron.

[76]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[77]  Karl J. Friston,et al.  Identifying global anatomical differences: Deformation‐based morphometry , 1998 .