Integration of Facial Thermography in EEG-based Classification of ASD

Autism spectrum disorder (ASD) is a neurodevelopmental disorder affecting social, communicative, and repetitive behavior. The phenotypic heterogeneity of ASD makes timely and accurate diagnosis challenging, requiring highly trained clinical practitioners. The development of automated approaches to ASD classification, based on integrated psychophysiological measures, may one day help expedite the diagnostic process. This paper provides a novel contribution for classifing ASD using both thermographic and EEG data. The methodology used in this study extracts a variety of feature sets and evaluates the possibility of using several learning models. Mean, standard deviation, and entropy values of the EEG signals and mean temperature values of regions of interest (ROIs) in facial thermographic images were extracted as features. Feature selection is performed to filter less informative features based on correlation. The classification process utilizes Naïve Bayes, random forest, logistic regression, and multi-layer perceptron algorithms. The integration of EEG and thermographic features have achieved an accuracy of 94% with both logistic regression and multi-layer perceptron classifiers. The results have shown that the classification accuracies of most of the learning models have increased after integrating facial thermographic data with EEG.

[1]  Yanchun Zhang,et al.  An Advanced Analysis System for Identifying Alcoholic Brain State Through EEG Signals , 2019, International Journal of Automation and Computing.

[2]  E. Salazar-López,et al.  The mental and subjective skin: Emotion, empathy, feelings and thermography , 2015, Consciousness and Cognition.

[3]  Julia Kluge,et al.  Laboratory Tests And Diagnostic Procedures , 2016 .

[4]  Mehmet Saltan,et al.  Modeling deflection basin using artificial neural networks with cross-validation technique in backcalculating flexible pavement layer moduli , 2008, Adv. Eng. Softw..

[5]  Sampath Jayarathna,et al.  A Survey of Attention Deficit Hyperactivity Disorder Identification Using Psychophysiological Data , 2019, Int. J. Online Biomed. Eng..

[6]  Hojjat Adeli,et al.  Fractality and a Wavelet-Chaos-Neural Network Methodology for EEG-Based Diagnosis of Autistic Spectrum Disorder , 2010, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[7]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[8]  S. Bejerot,et al.  Social anxiety in adult autism spectrum disorder , 2014, Psychiatry Research.

[9]  Dulani Meedeniya,et al.  Ultrasound Nerve Segmentation Using Deep Probabilistic Programming , 2019 .

[10]  Ridha Djemal,et al.  EEG-Based Computer Aided Diagnosis of Autism Spectrum Disorder Using Wavelet, Entropy, and ANN , 2017, BioMed research international.

[11]  Dulani Meedeniya,et al.  A Review of Supportive Computational Approaches for Neurological Disorder Identification , 2020 .

[12]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[13]  Zhenjie Yao,et al.  Applying Deep Learning to Individual and Community Health Monitoring Data: A Survey , 2018, International Journal of Automation and Computing.

[14]  Sarah Sharples,et al.  Physiological Parameter Response to Variation of Mental Workload , 2017, Hum. Factors.

[15]  C. Nelson,et al.  EEG complexity as a biomarker for autism spectrum disorder risk , 2011, BMC medicine.

[16]  Lucila Ohno-Machado,et al.  Logistic regression and artificial neural network classification models: a methodology review , 2002, J. Biomed. Informatics.

[17]  Rahul Kher,et al.  Signal Processing Techniques for Removing Noise from ECG Signals , 2019 .

[18]  Sampath Jayarathna,et al.  EEG-based Processing and Classification Methodologies for Autism Spectrum Disorder: A Review , 2019, Journal of Computer Science.

[19]  C. Lord,et al.  The Autism Diagnostic Observation Schedule: Revised Algorithms for Improved Diagnostic Validity , 2007, Journal of autism and developmental disorders.

[20]  S. D. Hill,et al.  Diurnal cortisol and temperature variation of normal and autistic children. , 1977, Developmental psychobiology.

[21]  I. D. Rubasinghe,et al.  Automated neuroscience decision support framework , 2020 .

[22]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[23]  Michael Murias,et al.  Early behavioral intervention is associated with normalized brain activity in young children with autism. , 2012, Journal of the American Academy of Child and Adolescent Psychiatry.

[24]  Mark S. Blumberg,et al.  Thermoregulation, energetics, and behavior. , 2017 .

[25]  Anna Truzzi,et al.  In utero testosterone exposure influences physiological responses to dyadic interactions in neurotypical adults , 2016, Acta Neuropsychiatrica.

[26]  Sampath Jayarathna,et al.  A Rule-Based System for ADHD Identification using Eye Movement Data , 2019, 2019 Moratuwa Engineering Research Conference (MERCon).

[27]  R. Cotterill,et al.  Fever in autistics , 1985, Nature.

[28]  Yasith Jayawardana,et al.  Electroencephalogram (EEG) for Delineating Objective Measure of Autism Spectrum Disorder (ASD) (Extended Version) , 2019, Computational Models for Biomedical Reasoning and Problem Solving.

[29]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[30]  Adam W. McCrimmon,et al.  Test Review: Autism Diagnostic Observation Schedule, Second Edition (ADOS-2) Manual (Part II): Toddler Module , 2014 .

[31]  Richard F. Ittenbach,et al.  Disparities in Diagnoses Received Prior to a Diagnosis of Autism Spectrum Disorder , 2007, Journal of autism and developmental disorders.

[32]  C. Lord,et al.  Standardizing ADOS Scores for a Measure of Severity in Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[33]  Клинические дисциплины Autism Diagnostic Observation Schedule , 2010 .

[34]  Lorenzo Rosasco,et al.  Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review , 2016, International Journal of Automation and Computing.

[35]  Irene Tobler,et al.  Temperature dependence of EEG frequencies during natural hypothermia , 1995, Brain Research.

[36]  BuscemaMassimo,et al.  Diagnosis of autism through EEG processed by advanced computational algorithms , 2017 .

[37]  Vincent G. Duffy,et al.  Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement , 2007 .

[38]  F. L. D. Silva,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[39]  Sampath Jayarathna,et al.  fMRI Feature Extraction Model for ADHD Classification Using Convolutional Neural Network , 2021, Int. J. E Health Medical Commun..

[40]  Sampath Jayarathna,et al.  ADHD Identification using Convolutional Neural Network with Seed-based Approach for fMRI Data , 2020, ICSCA.

[41]  D Shearn,et al.  Facial coloration and temperature responses in blushing. , 1990, Psychophysiology.

[42]  Amy L. Donaldson,et al.  Randomized, Controlled Trial of an Intervention for Toddlers With Autism: The Early Start Denver Model , 2010, Pediatrics.

[43]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[44]  Eddie Y K Ng,et al.  Analysis of IR thermal imager for mass blind fever screening. , 2004, Microvascular research.

[45]  C. Nelson,et al.  EEG Analytics for Early Detection of Autism Spectrum Disorder: A data-driven approach , 2018, Scientific Reports.

[46]  Sampath Jayarathna,et al.  Evaluating the EEG and Eye Movements for Autism Spectrum Disorder , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[47]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[48]  Michael V. Johnston,et al.  Behaviors Associated With Fever in Children With Autism Spectrum Disorders , 2007, Pediatrics.

[49]  Sarang S. Dalal,et al.  Reducing power line noise in EEG and MEG data via spectrum interpolation , 2019, NeuroImage.

[50]  Mohammad Reza Mosavi,et al.  Accurate Classification of EEG Signals Using Neural Networks Trained by Hybrid Population-physic-based Algorithm , 2018, International Journal of Automation and Computing.

[51]  M. Jaime,et al.  Electroencephalogram (EEG) for Delineating Objective Measure of Autism Spectrum Disorder (ASD) (Extended Version) , 2019, Computational Models for Biomedical Reasoning and Problem Solving.

[52]  Hojjat Adeli,et al.  Fuzzy Synchronization Likelihood-wavelet methodology for diagnosis of autism spectrum disorder , 2012, Journal of Neuroscience Methods.

[53]  Jan Rémi,et al.  The role of EEG in epilepsy: A critical review , 2009, Epilepsy & Behavior.

[54]  Thomas J. Watson,et al.  An empirical study of the naive Bayes classifier , 2001 .

[55]  Baisakhi Chakraborty,et al.  Application of CBR on viral fever detection system(VFDS) , 2011, 2011 9th IEEE International Conference on Industrial Informatics.

[56]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[57]  H. Adeli,et al.  Improved visibility graph fractality with application for the diagnosis of Autism Spectrum Disorder , 2012 .

[58]  Griffin M. Weber,et al.  BioNumbers—the database of key numbers in molecular and cell biology , 2009, Nucleic Acids Res..

[59]  Josep Call,et al.  APA handbook of comparative psychology: Basic concepts, methods, neural substrate, and behavior. , 2017 .

[60]  Sampath Jayarathna,et al.  An EEG based Channel Optimized Classification Approach for Autism Spectrum Disorder , 2019, 2019 Moratuwa Engineering Research Conference (MERCon).

[61]  Catherine Lord,et al.  The Autism Diagnostic Observation Schedule, Module 4: Revised Algorithm and Standardized Severity Scores , 2014, Journal of autism and developmental disorders.

[62]  Ion Smeureanu,et al.  Computer-Supported Collaborative Decision-Making , 2017 .

[63]  T. Deboer,et al.  Brain temperature dependent changes in the electroencephalogram power spectrum of humans and animals , 1998, Journal of sleep research.