Unkept promises of cognitive styles: A new look at old measurements

Cognitive style is thought to be a stable marker of one’s way to approach mental operations. While of wide interest over the last decades, its operationalization remains a challenge. The literature indicates that cognitive styles assessed via i) questionnaires are predicted by personality and ii) performance tests (e.g., Group Embedded Figures Test; GEFT) are related to general intelligence. In the first study, we tested the psychometric relationship between the Cognitive Style Index questionnaire (CSI) and personality inventories (NEO Five Factor Inventory; NEO-FFI, HEXACO Personality Inventory Revised; HEXACO-PI-R). In the second study, we assessed the CSI, NEO-FFI, GEFT and a general intelligence test (Raven’s Standard Progressive Matrices Test; RSMT). We found that CSI scores were largely predicted by personality and that CSI was uncorrelated with GEFT performance. Instead, better performance on the GEFT was associated with better performance on the RSMT. We conclude that i) cognitive style questionnaires overlap with personality inventories, ii) cognitive style performance tests do not measure cognitive styles and should not be used as such and iii) the cognitive style concept needs to be assessed with alternative measurement types. We discuss possible future directions.

[1]  Deborah A. Day,et al.  Information processing in the child: Significance of analytic and reflective attitudes. , 1964 .

[2]  Larry Katz,et al.  Evaluation of the reliability and validity of the cognitive styles analysis , 2004 .

[3]  H. A. Witkin,et al.  Personality through perception: an experimental and clinical study. , 1954 .

[4]  John Hayes,et al.  Cognitive Style and its Relevance for Management Practice , 1994 .

[5]  Ko-JanuchtaMarta,et al.  Visualizers versus verbalizers , 2017 .

[6]  Simon Cassidy *,et al.  Learning Styles: An overview of theories, models, and measures , 2004 .

[7]  Peter Bühlmann,et al.  MissForest - non-parametric missing value imputation for mixed-type data , 2011, Bioinform..

[8]  Simon Cassidy,et al.  Cognitive Style: Time to Experiment , 2016, Front. Psychol..

[9]  John Antonakis,et al.  The KAI Cognitive Style Inventory: Was it personality all along? , 2011 .

[10]  Dimo Dimov,et al.  From Opportunity Insight to Opportunity Intention: The Importance of Person–Situation Learning Match , 2007 .

[11]  M. Ashton,et al.  The HEXACO–60: A Short Measure of the Major Dimensions of Personality , 2009, Journal of personality assessment.

[12]  N. C. Silver,et al.  A Monte Carlo Evaluation of Tests for Comparing Dependent Correlations , 2003, The Journal of general psychology.

[13]  R. Sternberg,et al.  A Threefold Model of Intellectual Styles , 2005 .

[14]  R. Riding,et al.  Cognitive Styles—an overview and integration , 1991 .

[15]  Depression and anxiety in the United States: findings from the 2006 Behavioral Risk Factor Surveillance System. , 2008 .

[16]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[17]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[18]  A. Miyake,et al.  Not All Executive Functions Are Related to Intelligence , 2006, Psychological science.

[19]  J. Raven STANDARDIZATION OF PROGRESSIVE MATRICES, 1938 , 1941 .

[20]  John A. Johnson Ascertaining the validity of individual protocols from Web-based personality inventories. , 2005 .

[21]  S. Messick The nature of cognitive styles: Problems and promise in educational practice , 1984 .

[22]  J. Weisz,et al.  Field-dependence-independence on the Children's Embedded Figure Test: Cognitive style or cognitive level? , 1975 .

[23]  E. Cools A reflection on the future of the cognitive style field: a proposed research agenda , 2009 .

[24]  Nikolaos M. Avouris,et al.  Differences of Field Dependent/Independent Gamers on Cultural Heritage Playing: Preliminary Findings of an Eye-Tracking Study , 2016, EuroMed.

[25]  Reliability and Validity of the Divided Attention Questionnaire Abstract , 2005 .

[26]  Alan Mullally,et al.  Test-retest reliability of Riding's cognitive styles analysis test , 2004 .

[27]  Elizabeth R. Peterson,et al.  The effect of Cognitive Style Analysis (CSA) test on achievement: A meta-analytic review , 2015 .

[28]  Frank P. McKenna,et al.  Measures of field dependence: Cognitive style or cognitive ability? , 1984 .

[29]  Goodenough Dr,et al.  Field dependence and intellectual functioning. , 1961 .

[30]  Jason L. Huang,et al.  Detecting Insufficient Effort Responding with an Infrequency Scale: Evaluating Validity and Participant Reactions , 2014, Journal of Business and Psychology.

[31]  Christopher W. Allinson,et al.  The Cognitive Style Index: A Measure of Intuition‐Analysis For Organizational Research , 1996 .

[32]  R. Sternberg,et al.  STYLES OF THINKING IN THE SCHOOL , 1995 .

[33]  S. Kosslyn,et al.  Cognitive Style as Environmentally Sensitive Individual Differences in Cognition , 2014, Psychological science in the public interest : a journal of the American Psychological Society.

[34]  Elizabeth R. Peterson,et al.  Researching the psychology of cognitive style and learning style: Is there really a future? , 2009 .

[35]  Detlev Leutner,et al.  Visualizers versus verbalizers : Effects of cognitive style on learning with texts and pictures e An eye-tracking study , 2016 .

[36]  F. Pearson Handbook of intellectual styles: preferences in cognition, learning and thinking , 2013 .

[37]  Petros Patias,et al.  Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection , 2016, Lecture Notes in Computer Science.

[38]  Ian J. Deary,et al.  The reliability of Riding’s Cognitive Style Analysis test , 2003 .

[39]  Field Differentiation and Intelligence , 1980 .

[40]  H. Stumpf,et al.  A psychometric examination of the French translations of the NEO-PI-R and NEO-FFI. , 1998 .

[41]  R. R. Abidin Psychological Assessment Resources , 1995 .

[42]  H. A. Witkin A Manual for the embedded figures tests , 1971 .

[43]  Eva Cools,et al.  Development and Validation of the Cognitive Style Indicator , 2007, The Journal of psychology.

[44]  R. P. McDonald,et al.  Test Theory: A Unified Treatment , 1999 .

[45]  M. Kirton,et al.  Have Adaptors and Innovators Equal Levels of Creativity? , 1978 .

[46]  Elizabeth M. Poposki,et al.  Detecting and Deterring Insufficient Effort Responding to Surveys , 2012 .

[47]  M. Kirton Adaptors and Innovators: A Description and Measure. , 1976 .

[48]  Clay M. Voorhees,et al.  Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies , 2016 .

[49]  Steven J. Armstrong,et al.  Methodological practices in cognitive style research: Insights and recommendations from the field of business and psychology , 2014 .

[50]  R. Sternberg,et al.  Are Cognitive Styles Still in Style , 1997 .

[51]  J. Antonakis,et al.  Looking for validity or testing it? The perils of stepwise regression, extreme-scores analysis, heteroscedasticity, and measurement error , 2011 .

[52]  S. A. Karp,et al.  Psychological Differentiation: Studies of Development , 1963 .

[53]  Steven L. Wise,et al.  An Investigation of the Differential Effort Received by Items on a Low-Stakes Computer-Based Test , 2006 .

[54]  L. Bernold,et al.  Group embedded figures test and academic achievement in engineering education , 2001 .

[55]  R. Riding On the Nature of Cognitive Style , 1997 .

[56]  H. A. Witkin,et al.  Studies in space orientation; further experiments on perception of the upright with displaced visual fields. , 1948, Journal of experimental psychology.

[57]  M. Sarstedt,et al.  A new criterion for assessing discriminant validity in variance-based structural equation modeling , 2015 .

[58]  K. Lange,et al.  Cognitive impairment in adult ADHD--perspective matters! , 2015, Neuropsychology.

[59]  A. Feingold,et al.  Gender differences in personality: a meta-analysis. , 1994, Psychological bulletin.

[60]  Maddalena Boccia,et al.  Does field independence predict visuo-spatial abilities underpinning human navigation? Behavioural evidence , 2016, Experimental Brain Research.

[61]  M. Waring,et al.  Application of styles in educational instruction and assessment , 2011 .

[62]  V. Rusalov,et al.  Cognitive styles and personality , 2016 .

[63]  M. Kozhevnikov Cognitive styles in the context of modern psychology: toward an integrated framework of cognitive style. , 2007, Psychological bulletin.

[64]  Hong-Yu Cheng,et al.  Examining the relationship between holistic/analytic style and classroom learning behaviors of high school students , 2017 .

[65]  H. A. Witkin Psychological differentiation; studies of development , 1974 .

[66]  C. Marmar Conitive Styles: Essence and Origins , 1982 .

[67]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[68]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .