Assessing Executive Function Using a Computer Game: Computational Modeling of Cognitive Processes

Early and reliable detection of cognitive decline is one of the most important challenges of current healthcare. In this project, we developed an approach whereby a frequently played computer game can be used to assess a variety of cognitive processes and estimate the results of the pen-and-paper trail making test (TMT)--known to measure executive function, as well as visual pattern recognition, speed of processing, working memory, and set-switching ability. We developed a computational model of the TMT based on a decomposition of the test into several independent processes, each characterized by a set of parameters that can be estimated from play of a computer game designed to resemble the TMT. An empirical evaluation of the model suggests that it is possible to use the game data to estimate the parameters of the underlying cognitive processes and using the values of the parameters to estimate the TMT performance. Cognitive measures and trends in these measures can be used to identify individuals for further assessment, to provide a mechanism for improving the early detection of neurological problems, and to provide feedback and monitoring for cognitive interventions in the home.

[1]  I. Scott MacKenzie,et al.  Movement time prediction in human-computer interfaces , 1992 .

[2]  Philip D. Harvey,et al.  Administration and interpretation of the Trail Making Test , 2006, Nature Protocols.

[3]  G. D. Logan Task Switching , 2022 .

[4]  Misha Pavel,et al.  Unobtrusive monitoring of computer interactions to detect cognitive status in elders , 2004, IEEE Transactions on Information Technology in Biomedicine.

[5]  S. Sternberg The discovery of processing stages , 1969 .

[6]  R. Benedict,et al.  Practice effects during repeated administrations of memory tests with and without alternate forms. , 1998, Journal of clinical and experimental neuropsychology.

[7]  I. MacKenzie,et al.  A note on the information-theoretic basis of Fitts' law. , 1989, Journal of motor behavior.

[8]  Timothy A. Salthouse,et al.  Process analysis of adult age effects on a computer-administered Trail Making Test. , 1995 .

[9]  MacKenzie Is A Note on the Information-Theoretic Basis for Fitts’ Law , 1989 .

[10]  F. Barceló,et al.  Construct validity of the Trail Making Test: Role of task-switching, working memory, inhibition/interference control, and visuomotor abilities , 2009, Journal of the International Neuropsychological Society.

[11]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[12]  Arthur F Kramer,et al.  Performance of a computer‐based assessment of cognitive function measures in two cohorts of seniors , 2013, International journal of geriatric psychiatry.

[13]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[14]  Paul Maruff,et al.  The effects of practice on the cognitive test performance of neurologically normal individuals assessed at brief test-retest intervals. , 2003, Journal of the International Neuropsychological Society : JINS.

[15]  Misha Pavel,et al.  A Framework for Cognitive Monitoring Using Computer Game Interactions , 2007, MedInfo.

[16]  Adriana M. Seelye,et al.  Status of computerized cognitive testing in aging: A systematic review , 2008, Alzheimer's & Dementia.

[17]  P. Ricciardelli,et al.  Monitoring cognitive changes: psychometric properties of six cognitive tests. , 2004, The British journal of clinical psychology.

[18]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[19]  John R. Duncan,et al.  Visual search and visual attention , 1985 .

[20]  T. Salthouse,et al.  What cognitive abilities are involved in trail-making performance? , 2011, Intelligence.

[21]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[22]  Amir Poreh,et al.  Decomposition of the Trail Making Test - Reliability and Validity of a Computer Assisted Method for Data Collection , 2012 .

[23]  Philip Schatz,et al.  Applications of Computer-based Neuropsychological Assessment , 2002, The Journal of head trauma rehabilitation.

[24]  Mireille Bastien-Toniazzo,et al.  Nonequivalence of Computerized and Paper-and-Pencil Versions of Trail Making Test , 2007, Perceptual and motor skills.

[25]  F. Donders On the speed of mental processes. , 1969, Acta psychologica.

[26]  L. Rabin,et al.  Assessment practices of clinical neuropsychologists in the United States and Canada: a survey of INS, NAN, and APA Division 40 members. , 2005, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[27]  T. Tombaugh Trail Making Test A and B: normative data stratified by age and education. , 2004, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[28]  Misha Pavel,et al.  Models of cognitive performance based on home monitoring data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.