Classification of user performance in the Ruff Figural Fluency Test based on eye-tracking features

Cognitive assessment in neurological diseases represents a relevant topic due to its diagnostic significance in detecting disease, but also in assessing progress of the treatment. Computer-based tests provide objective and accurate cognitive skills and capacity measures. The Ruff Figural Fluency Test (RFFT) provides information about non-verbal capacity for initiation, planning, and divergent reasoning. The traditional paper form of the test was transformed into a computer application and examined. The RFFT was applied in an experiment performed among 70 male students to assess their cognitive performance in the laboratory environment. Each student was examined in three sequential series. Besides the students’ performances measured by using in app keylogging, the eye-tracking data obtained by non-invasive video-based oculography were gathered, from which several features were extracted. Eye-tracking features combined with performance measures (a total number of designs and/or error ratio) were applied in machine learning classification. Various classification algorithms were applied, and their accuracy, specificity, sensitivity and performance were compared.

[1]  D. Harrison,et al.  The Ruff Figural Fluency Test: heightened right frontal lobe delta activity as a function of performance. , 2005, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[2]  Mark S. Aloia,et al.  Interrater Reliability of the Ruff Figural Fluency Test , 1998, Assessment.

[3]  Marianne Regard,et al.  Children's Production on Verbal and Non-Verbal Fluency Tasks , 1982, Perceptual and motor skills.

[4]  Relationships between Verbal and Nonverbal Fluency Measures: Implications for Assessment of Executive Functioning , 1997, Psychological reports.

[5]  Ronald M. Ruff,et al.  The ruff figural fluency test: A normative study with adults , 1987 .

[6]  J. Slaets,et al.  Reference Data for the Ruff Figural Fluency Test Stratified by Age and Educational Level , 2011, PloS one.

[7]  J. Gómez-Valdés,et al.  Discriminant Function Analysis for Sex Assessment in Pelvic Girdle Bones: Sample from the Contemporary Mexican Population , 2011, Journal of forensic sciences.

[8]  Tobias M. Merz,et al.  Cognitive performance in high-altitude climbers: a comparative study of saccadic eye movements and neuropsychological tests , 2013, European Journal of Applied Physiology.

[9]  Julien Epps,et al.  Pupillary transient responses to within-task cognitive load variation , 2016, Comput. Methods Programs Biomed..

[10]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[11]  O. Hardiman,et al.  Ocular fixation instabilities in motor neurone disease , 2009, Journal of Neurology.

[12]  J. Sharpe,et al.  Saccadic duration and intrasaccadic fatigue in myasthenic and nonmyasthenic ocular palsies , 1995, Neurology.

[13]  Stephen G Lisberger,et al.  Medial Versus Lateral Frontal Lobe Contributions to Voluntary Saccade Control as Revealed by the Study of Patients with Frontal Lobe Degeneration , 2006, The Journal of Neuroscience.

[14]  P. Krukow,et al.  Ineffective initiation contributes to deficient verbal and non-verbal fluency in patients with schizophrenia , 2017, Cognitive neuropsychiatry.

[15]  G. Riva,et al.  An eye-tracking controlled neuropsychological battery for cognitive assessment in neurological diseases , 2017, Neurological Sciences.

[16]  C. Pierrot-Deseilligny,et al.  Cortical control of saccades , 1998, Experimental Brain Research.

[17]  Jan Kassubek,et al.  Eye-tracking controlled cognitive function tests in patients with amyotrophic lateral sclerosis: a controlled proof-of-principle study , 2015, Journal of Neurology.

[18]  D. Lulé,et al.  Eye Movement Deficits Are Consistent with a Staging Model of pTDP-43 Pathology in Amyotrophic Lateral Sclerosis , 2015, PloS one.

[19]  J. Slaets,et al.  Longitudinal Study of Performance on the Ruff Figural Fluency Test in Persons Aged 35 Years or Older , 2015, PloS one.

[20]  Jacobus F. A. Jansen,et al.  Reduced Structural Connectivity between Sensorimotor and Language Areas in Rolandic Epilepsy , 2013, PloS one.

[21]  Anneli Olsen The Tobii IVT Fixation Filter Algorithm description , 2012 .

[22]  Qing Yang,et al.  Specific saccade deficits in patients with Alzheimer’s disease at mild to moderate stage and in patients with amnestic mild cognitive impairment , 2012, AGE.

[23]  M. Larson Analysis of Variance , 2008, Circulation.

[24]  M. A. Wong,et al.  A Hybrid Clustering Method for Identifying High-Density Clusters , 1982 .

[25]  A P Shimamura,et al.  Verbal and design fluency in patients with frontal lobe lesions , 2001, Journal of the International Neuropsychological Society.