Adaptive Skill as the Conditio Sine Qua Non of Expertise

This critical interpretive research synthesis is on the topic of adaptation and skill. After an initial identification of 1995 abstracts we identified and collated a database of 140 publications that explicitly reference expertise and adaptation. We found that empirical data on adaptive skill are sparse and the literature base is largely conceptual. We differentiate the adaptive nature of expertise from routine or every day skill, and we redress the balance between what constitutes expertise and when expertise matters. We present an overview of current models of expertise including a project that we completed for the UK Ministry of Defence on the nature of adaptive skill. We discuss implications for future training by presenting empirically based training principles designed to develop adaptive skill. We assert that adaptive skill is the conditio sine qua non of expertise and conclude with suggestions for further research.

[1]  Erik Hollnagel,et al.  Cognitive Systems Engineering: New Wine in New Bottles , 1983, Int. J. Man Mach. Stud..

[2]  G. Klein.  Macrocognitive Measures for Evaluating Cognitive Work , 2018, Macrocognition Metrics and Scenarios.

[3]  Gary Klein,et al.  The ShadowBox Approach to Cognitive Skills Training , 2016 .

[4]  G. Klein,et al.  Cognitive Transformation Theory: Contrasting Cognitive and Behavioral Learning , 2006 .

[5]  Robert S. Bolia,et al.  Power to the Edge: Command . . . Control . . . in the Information Age , 2006 .

[6]  J. Bradshaw,et al.  Institute for Human and Machine Cognition , 2022 .

[7]  Robert R. Hoffman,et al.  The Psychology of Expertise: Cognitive Research and Empirical AI , 2011 .

[8]  Paul J. Feltovich,et al.  Cognitive Flexibility, Constructivism, and Hypertext: Random Access Instruction for Advanced Knowledge Acquisition in Ill-Structured Domains , 2012 .

[9]  Daniel L. Schwartz,et al.  Inventing to Prepare for Future Learning: The Hidden Efficiency of Encouraging Original Student Production in Statistics Instruction , 2004 .

[10]  K. Weick.  The Collapse of Sensemaking in Organizations: The Mann Gulch Disaster , 1993 .

[11]  Raanan Lipshitz,et al.  Planning Under Time Pressure: An Attempt Toward a Prescriptive Model of Military Tactical Decision Making , 2004 .

[12]  Rand J. Spiro,et al.  Cognitive flexibility theory : advanced knowledge acquisition in ill-structured domains , 1988 .

[13]  James W. Lussier,et al.  Think Like a Commander Prototype: Instructor's Guide to Adaptive Thinking , 2003 .

[14]  Karol G. Ross,et al.  Small Unit Decision Making (SUDM) Assessment Battery , 2014 .

[15]  P. Feltovich,et al.  The nature of conceptual understanding in biomedicine : the deep structure of complex ideas and the development of misconceptions , 1988 .

[16]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[17]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[18]  H. Gr.  Compensatory control in the regulation of human performance under stress and high workload; a cognitive-energetical framework. , 1997 .

[19]  Chris Baber,et al.  Collaborative sense-making during simulated Intelligence Analysis Exercises , 2016, Int. J. Hum. Comput. Stud..

[20]  Sterling Wiggins,et al.  Team sensemaking , 2010 .

[21]  J. Mestre.  Transfer of learning from a modern multidisciplinary perspective , 2005 .

[22]  Fernand Gobet,et al.  Experts’ memory superiority for domain-specific random material generalizes across fields of expertise: A meta-analysis , 2016, Memory & Cognition.

[23]  Gary Klein,et al.  A Recognitional Planning Model , 1999 .

[24]  J. Staszewski.  Learning from Observing an Expert’s Demonstration, Explanations, and Dialogues , 2013 .

[25]  G. Klein,et al.  The macrocognition framework of naturalistic decision making , 2008 .

[26]  C. Tanner,et al.  Diagnostic Reasoning Strategies Of Nurses and Nursing Students , 1987, Nursing research.

[27]  S. Kozlowski,et al.  Enhancing Learning Performance and Adaptability for Complex Tasks , 2005 .

[28]  J. Greenwood,et al.  Some surprising similarities in the clinical reasoning of 'expert' and 'novice' orthopaedic nurses: report of a study using verbal protocols and protocol analyses. , 2006, Journal of advanced nursing.

[29]  James W. Lussier,et al.  Positive Transfer of Adaptive Battlefield Thinking Skills , 2007 .

[30]  Paul Ward,et al.  Simulation for Performance and Training. , 2006 .

[31]  Eduardo Salas,et al.  Guidelines for Training Adaptive Expertise , 2010 .

[32]  Paul J. Feltovich,et al.  Learning, Teaching and Testing for Complex Conceptual Understanding. , 1991 .

[33]  Barbara Hayes-Roth,et al.  A Cognitive Model of Planning , 1979, Cogn. Sci..

[34]  Emily S. Patterson,et al.  Macrocognition Metrics and Scenarios: Design and Evaluation for Real-World Teams , 2012 .

[35]  Karol G. Ross,et al.  The Recognition-Primed Decision Model , 2004 .

[36]  D. Hunt.  Cognition and Learning , 1989 .

[37]  Robert L. Wears,et al.  Resilience Engineering: Concepts and Precepts , 2006, Quality and Safety in Health Care.

[38]  Rand J. Spiro,et al.  Multiple analogies for complex concepts: antidotes for analogy-induced misconception in advanced knowledge acquisition , 1988 .

[39]  S. Corcoran,et al.  Task Complexity and Nursing Expertise as Factors In Decision Making , 1986, Nursing research.

[40]  Damian Farrow,et al.  Training Perceptual-Cognitive Skills: Can Sport Psychology Research Inform Military Decision Training? , 2008 .

[41]  Gary Klein.  Flexecution, Part 2: Understanding and Supporting Flexible Execution , 2007, IEEE Intelligent Systems.

[42]  Gary Klein,et al.  Fighting in the Fog: Dealing with Battlefield Uncertainty , 1996 .

[43]  J. Merriënboer,et al.  How experts deal with novel situations: A review of adaptive expertise , 2014 .

[44]  J. V. van Merriënboer,et al.  Measuring adaptive expertise: development and validation of an instrument , 2016 .

[45]  W. Kintsch.  The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[46]  J. Weitzenfeld,et al.  Improvement of skills for solving‐ ill‐defined problems , 1978 .

[47]  G. R. J. Hockey.  Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework , 1997, Biological Psychology.

[48]  K. WeiK..  The Collapse of Sensemaking in Organizations: The Mann Gulch Disaster , 2009, STUDI ORGANIZZATIVI.

[49]  Robert R. Hoffman,et al.  Mentoring: A Leverage Point for Intelligent Systems? , 2015, IEEE Intelligent Systems.

[50]  G. Conway,et al.  Modeling and aiding intuition in organizational decision making: a call for bridging academia and practice , 2016 .

[51]  Susanne P. Lajoie,et al.  Sherlock: A Coached Practice Environment for an Electronics Troubleshooting Job. , 1988 .

[52]  M. Dixon-Woods,et al.  Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups , 2006 .

[53]  Berndt Brehmer,et al.  The Dynamic OODA Loop : Amalgamating Boyd ’ s OODA Loop and the Cybernetic Approach to Command and Control ASSESSMENT , TOOLS AND METRICS , 2005 .

[54]  Alan M. Lesgold,et al.  Tools to assist learning by doing: achieving and assessing efficient technology for learning , 2001 .

[55]  Ann Blandford,et al.  Understanding “influence”: An empirical test of the Data‐Frame Theory of Sensemaking , 2016, J. Assoc. Inf. Sci. Technol..

[56]  Paul J. Feltovich,et al.  Learners' (mis)understanding of important and difficult concepts: a challenge to smart machines in education , 2001 .

[57]  Stuart K. Card,et al.  The cost structure of sensemaking , 1993, INTERCHI.

[58]  James W. Lussier,et al.  Assessment of the Think Like a Commander Training Program , 2004 .

[59]  Gary Klein,et al.  Flexecution as a Paradigm for Replanning, Part 1 , 2007, IEEE Intelligent Systems.

[60]  Robert R. Hoffman,et al.  The Problem of Extracting the Knowledge of Experts from the Perspective of Experimental Psychology , 1987, AI Mag..

[61]  Adaptive Teams , 2007 .

[62]  Gary Klein,et al.  Distributed Planning Teams , 1999 .

[63]  Robert R. Hoffman,et al.  Developing skilled adaptive performance : a scoping study : Final technical report v3 , 2016 .

[64]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[65]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[66]  David D Woods,et al.  Steering the Reverberations of Technology Change on Fields of Practice: Laws that Govern Cognitive Work , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[67]  David W. Eccles,et al.  A commentary on “team cognition and expert teams: Emerging insights into performance for exceptional teams” , 2006 .

[68]  Erich J. Petushek,et al.  Macrocognition : the science and engineering of sociotechnical work systems , 2018 .

[69]  Jeffrey M. Bradshaw,et al.  Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity , 2004, IEEE Intell. Syst..

[70]  Daniel Siebert,et al.  Quantitative reasoning in a reconceived view of transfer , 2002 .

[71]  Jennifer K. Phillips,et al.  A Data–Frame Theory of Sensemaking , 2007 .

[72]  K. A. Ericsson,et al.  Science Current Directions in Psychological of Expert and Exceptional Performance Capturing the Naturally Occurring Superior Performance of Experts in the Laboratory : toward a Science on Behalf Of: Association for Psychological Science , 2022 .

[73]  Erica L. Wohldmann,et al.  Specificity effects in training and transfer of speeded responses. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[74]  Paul J. Feltovich,et al.  Accelerated Expertise: Training for High Proficiency in a Complex World , 2013 .

[75]  Jeffrey M. Bradshaw,et al.  Accelerated Learning ( ? ) , 2011 .

[76]  P. Ward,et al.  Expertise and Expert Performance-based Training (ExPerT) in Complex Domains , 2009 .

[77]  Paul Ward,et al.  Expert Performance in Nursing: Reviewing Research on Expertise in Nursing Within the Framework of the Expert‐Performance Approach , 2007, ANS. Advances in nursing science.

[78]  T. Ormerod,et al.  Naturalistic Decision Making and Macrocognition , 2012 .

[79]  A. Mark Williams,et al.  Skill-based differences in option generation in a complex task: a verbal protocol analysis , 2011, Cognitive Processing.

[80]  Robert R. Hoffman,et al.  How Can Expertise be Defined? Implications of Research From Cognitive Psychology , 1998 .

[81]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[82]  R. Wood.  Task complexity: Definition of the construct , 1986 .

[83]  Ann Blandford,et al.  Making Sense of Digital Footprints in Team-Based Legal Investigations: The Acquisition of Focus , 2011, Hum. Comput. Interact..

[84]  Dietrich Dorner,et al.  The Logic of Failure: Why Things Go Wrong and What We Can Do to Make Them Right , 1996 .

[85]  Eduardo Salas,et al.  A century of progress in industrial and organizational psychology: Discoveries and the next century. , 2017, The Journal of applied psychology.

[86]  T. S. Hasselbring,et al.  Anchored Instruction: Why We Need It and How Technology Can Help , 2012 .

[87]  Tania Reynoldsa,et al.  Organizational Behavior and Human Decision Processes , 2020 .

[88]  Vincent Aleven,et al.  Is it better to give than to receive? The assistance dilemma as a fundamental unsolved problem in the cognitive science of learning and instruction , 2008 .

[89]  Gary Klein,et al.  Deliberate performance: Accelerating expertise in natural settings , 2010 .

[90]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[91]  P. Feltovich,et al.  Issues of expert flexibility in contexts characterized by complexity and change , 1997 .

[92]  R. Hoffman,et al.  Should We Rethink How We Do OPORDs , 2006 .

[93]  G. Hatano,et al.  TWO COURSES OF EXPERTISE , 1984 .

[94]  Daniel M. Russell,et al.  Introduction to this Special Issue on Sensemaking , 2011, Hum. Comput. Interact..

[95]  L. Wilkins,et al.  On the power of intuition. , 2001, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[96]  Michael J. McCloskey,et al.  Decision-Centered MOUT Training for Small Unit Leaders , 2001 .

[97]  Gary Klein,et al.  Rapid Decision Making on the Fire Ground , 1986 .

[98]  Timothy J. Neville.  Streetlights and shadows: searching for the keys to adaptive decision making , 2014 .

[99]  Robert Milne,et al.  Local Efforts with Global Impact: Europe's Thriving AI Communities , 2003, IEEE Intell. Syst..

[100]  Richard E. Hayes,et al.  Power to the Edge: Command, Control in the Information Age , 2003 .