An Analysis of Eye-Tracking Features and Modelling Methods for Free-Viewed Standard Stimulus: Application for Schizophrenia Detection

Currently psychiatry is a medical field lacking an automated diagnostic process. The presence of a mental disorder is established by observing its typical symptoms. Eye-movement specifics have already been established as an “endophenotype” for schizophrenia, but an automated diagnostic process of eye-movement analysis is still lacking. This article presents several novel approaches for the automatic detection of a schizophrenic disorder based on a free-view image test using a Rorschach inkblot and an eye tracker. Several features that enabled us to analyse the eye-tracker signal as a whole as well as its specific parts were tested. The variety of features spans global (heat maps, gaze plots), sequences of features (means, variances, and spectra), static (x and y signals as 2D images), dynamic (velocities), and model-based (limiting probabilities and transition matrices) categories. For each set of features, a proper modelling and classification method was designed (convolutional, recurrent, fully connected and combined neural networks; Hidden Markov models). By doing so, it was possible to find the importance of each feature and its physical representation using k-fold cross validation and a paired t-test. The dataset was sampled on 22 people with schizophrenia and 22 healthy individuals. The most successful approach was based on heat maps using all data and convolutional networks, reaching a 78.8% accuracy, which is a 10.5% improvement over the reference method. From all tested methods, there are two in an 85% accuracy range and over fifteen others in a 75% accuracy range at a 10% significance level.

[1]  P. Benson,et al.  Simple Viewing Tests Can Detect Eye Movement Abnormalities That Distinguish Schizophrenia Cases from Controls with Exceptional Accuracy , 2012, Biological Psychiatry.

[2]  Elizeu Coutinho de Macedo,et al.  Analysis of exploratory eye movements in patients with schizophrenia during visual scanning of projective tests' figures , 2010 .

[3]  Philip J. Benson,et al.  Global visual scanning abnormalities in schizophrenia and bipolar disorder , 2006, Schizophrenia Research.

[4]  J. Rice Mathematical Statistics and Data Analysis , 1988 .

[5]  T. Pansell,et al.  Screening for Dyslexia Using Eye Tracking during Reading , 2016, PloS one.

[6]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[7]  S. Kay,et al.  The positive and negative syndrome scale (PANSS) for schizophrenia. , 1987, Schizophrenia bulletin.

[8]  Tim Chuk,et al.  Eye movement analysis with switching hidden Markov models , 2019, Behavior Research Methods.

[9]  Leanne M Williams,et al.  Visual scanpaths to positive and negative facial emotions in an outpatient schizophrenia sample , 2002, Schizophrenia Research.

[10]  H. Fukuzako,et al.  Eye movements during the Rorschach test in schizophrenia , 2002, Psychiatry and clinical neurosciences.

[11]  Biing-Hwang Juang,et al.  Hidden Markov Models for Speech Recognition , 1991 .

[12]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[13]  K. Kasai,et al.  Eye movement as a biomarker of schizophrenia: Using an integrated eye movement score , 2017, Psychiatry and clinical neurosciences.

[14]  Juraj Kacur,et al.  GMM Based Detection of Schizophrenia Using Eye Tracking , 2019, 2019 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB).

[15]  Sheldon M. Ross,et al.  Introduction to probability models , 1975 .

[16]  Radoslav Vargic,et al.  Detection of Schizophrenia Spectrum Disorders Using Saliency Maps , 2017, 2017 IEEE 11th International Conference on Application of Information and Communication Technologies (AICT).

[17]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[18]  P. Benson,et al.  Atypical scanpaths in schizophrenia: evidence of a trait- or state-dependent phenomenon? , 2011, Journal of psychiatry & neuroscience : JPN.