A New Behavioral Measure of Cognitive Flexibility

Individual differences in cognitive flexibility may underlie a variety of different user behaviors, but a lack of effective measurement tools has limited the predictive and descriptive potential of cognitive flexibility in human-computer interaction applications. This study presents a new computerized measure of cognitive flexibility, and then provides evidence for convergent validity. Our findings indicate moderate to strong correlations with the Trail Making Task, and in particular, those aspects of the task most closely associated with cognitive flexibility. Results of this study provide support for the validity of a new measure of cognitive flexibility. We conclude by discussing the measure's potential applicability in the field of HCI.

[1]  C. D. De Dreu,et al.  A meta-analysis of 25 years of mood-creativity research: hedonic tone, activation, or regulatory focus? , 2008, Psychological bulletin.

[2]  Brendan Z. Allison,et al.  Brain-Computer Interfaces , 2010 .

[3]  K. Lesch,et al.  Dopamine and cognitive control: The influence of spontaneous eyeblink rate, DRD4 exon III polymorphism and gender on flexibility in set-shifting , 2007, Brain Research.

[4]  S. Monsell,et al.  Costs of a predictible switch between simple cognitive tasks. , 1995 .

[5]  Gary M. Olson,et al.  The growth of cognitive modeling in human-computer interaction since GOMS , 1990 .

[6]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[7]  S. Monsell.  Task switching , 2003, Trends in Cognitive Sciences.

[8]  F. Barceló,et al.  Construct validity of the Trail Making Test: Role of task-switching, working memory, inhibition/interference control, and visuomotor abilities , 2009, Journal of the International Neuropsychological Society.

[9]  S. Monsell.  Task-set reconfiguration processes do not imply a control homunuculus: Reply to Altmann , 2003, Trends in Cognitive Sciences.

[10]  J. V. Vander Wal,et al.  The Cognitive Flexibility Inventory: Instrument Development and Estimates of Reliability and Validity , 2010, Cognitive Therapy and Research.

[11]  R. Engle,et al.  Is working memory capacity task dependent , 1989 .

[12]  R. Kelly Rainer,et al.  The Influence of Individual Differences on Skill in End-User Computing , 1992, J. Manag. Inf. Syst..

[13]  S. Crowe,et al.  The differential contribution of mental tracking, cognitive flexibility, visual search, and motor speed to performance on parts A and B of the Trail Making Test. , 1998, Journal of clinical psychology.

[14]  Robert J. Youmans,et al.  Creating a Computerized Assessment of Cognitive Flexibility with a User-Friendly Participant and Experimenter Interface , 2012 .

[15]  Robert J. Youmans,et al.  Individual Differences in Cognitive Flexibility Predict Poetry Originality , 2013, HCI.

[16]  Robert T Knight,et al.  Both random and perseverative errors underlie WCST deficits in prefrontal patients , 2002, Neuropsychologia.

[17]  Paul J. Eslinger,et al.  Frontal lobe and frontal-striatal substrates for different forms of human cognitive flexibility , 1993, Neuropsychologia.

[18]  W. A. Scott.  Cognitive Complexity and Cognitive Flexibility , 1962 .

[19]  R. Rubin,et al.  A New Measure of Cognitive Flexibility , 1995 .

[20]  Nuray Aykin,et al.  Individual differences in human-computer interaction: a survey , 1991 .

[21]  Ivonne J. Figueroa,et al.  Reactive Task-Set Switching Ability, Not Working Memory Capacity, Predicts Change Blindness Sensitivity , 2011 .

[22]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[23]  N. Squires,et al.  Construct validity in the Trail Making Test: what makes Part B harder? , 1995, Journal of clinical and experimental neuropsychology.

[24]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[25]  Ben Shneiderman,et al.  Determining Causes and Severity of End-User Frustration , 2004, Int. J. Hum. Comput. Interact..

[26]  Todd B. Parrish,et al.  A Brain Mechanism for Facilitation of Insight by Positive Affect , 2009, Journal of Cognitive Neuroscience.

[27]  Andrea M Philipp,et al.  Control and interference in task switching--a review. , 2010, Psychological bulletin.

[28]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[29]  R. Reitan.  The relation of the trail making test to organic brain damage. , 1955, Journal of consulting psychology.

[30]  Richard P. Heitz,et al.  An automated version of the operation span task , 2005, Behavior research methods.

[31]  Chetwyn C H Chan,et al.  Competence of people with intellectual disabilities on using human-computer interface. , 2009, Research in developmental disabilities.

[32]  R. Reitan.  Validity of the Trail Making Test as an Indicator of Organic Brain Damage , 1958 .

[33]  Thorsten O. Zander,et al.  Enhancing Human-Computer Interaction with Input from Active and Passive Brain-Computer Interfaces , 2010, Brain-Computer Interfaces.

[34]  K M Heilman,et al.  Noradrenergic modulation of cognitive flexibility in problem solving. , 1999, Neuroreport.

[35]  B. Harrison.  Las Vegas, Nevada , 2002 .

[36]  Kar Yan Tam,et al.  Determinants of User Acceptance of Digital Libraries: An Empirical Examination of Individual Differences and System Characteristics , 2002, J. Manag. Inf. Syst..

[37]  Ivonne J. Figueroa,et al.  Developing an Easy-to-Administer, Objective, and Valid Assessment of Cognitive Flexibility , 2011 .

[38]  Matthew M. Martin,et al.  The cognitive flexibility scale: Three validity studies , 1998 .