SECOND THOUGHTS ABOUT EXPERT POLITICAL JUDGMENT: REPLY TO THE SYMPOSIUM

Imagine devoting years of arduous study to master the intricacies of a subject*and years more of hard labor applying and refining your knowledge in your chosen profession. You secure a steady income and the respect of your peers and the broader society. And then along comes the Information Revolution which starts to nibble away, ever more aggressively as the decades pass, at your professional prerogatives. Computer scientists, cognitive psychologists, and evidence-based management consultants demonstrate that increasing percentages of your work could be done better by ever more sophisticated sets of algorithms (Dawes, Meehl, and Faust 1989)*and the remainder of your job could be done better if you were held tightly accountable for following a public checklist of do’s and don’ts (Gawande 2010). Statisticians show that your judgment is no more accurate than, and often less accurate than, the wisdom of the crowd (Surowiecki 2004). In a nutshell, your status as an expert is under siege. The mystique of professionalism surrounding you and your pronouncements has begun to fade*and so does demand for your services. Sociologists who specialize in the study of professions see a familiar pattern. Professions are doomed to fall from grace when they lose their ability to convince powerful outsiders that they possess special judgmental skills that cannot be easily reproduced elsewhere (Wilensky

[1]  PUTTING POLITICAL EXPERTS TO THE TEST , 2010 .

[2]  Philip E. Tetlock,et al.  Social functionalist frameworks for judgment and choice: intuitive politicians, theologians, and prosecutors. , 2002, Psychological review.

[3]  HAVE THE EXPERTS BEEN WEIGHED, MEASURED, AND FOUND WANTING? , 2007 .

[4]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[5]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[6]  R. Jervis Why Intelligence Fails: Lessons from the Iranian Revolution and the Iraq War , 2010 .

[7]  James Clarke,et al.  THE CHECKLIST MANIFESTO , 2011, The Ulster Medical Journal.

[8]  J. Ioannidis Why Most Published Research Findings Are False , 2019, CHANCE.

[9]  Geoffrey Parker,et al.  Unmaking the West : "what-if?" scenarios that rewrite world history , 2006 .

[10]  R. Jervis Perception and misperception in international politics , 1976 .

[11]  G. McGough The checklist manifesto: how to get things right Atul Gawande The checklist manifesto: how to get things right Metropolitan Books £12.99 224pp 9780805091748 0805091742 , 2010 .

[12]  John Sloan,et al.  Wisdom of the crowd , 2005, Nature.

[13]  J. Ioannidis Why Most Published Research Findings Are False , 2005, PLoS medicine.

[14]  S. Fuller THINKING THE UNTHINKABLE AS A RADICAL SCIENTIFIC PROJECT , 2010 .

[15]  R. Dawes,et al.  Heuristics and Biases: Clinical versus Actuarial Judgment , 2002 .

[16]  P. Quirk THE TROUBLE WITH EXPERTS , 2010, Expertise: A Philosophical Introduction.

[17]  Richard E. Redding,et al.  Sociopolitical diversity in psychology. The case for pluralism. , 2001, The American psychologist.

[18]  D. Kahneman,et al.  Do Frequency Representations Eliminate Conjunction Effects? An Exercise in Adversarial Collaboration , 2001, Psychological science.

[19]  JUDGING JUDGMENT , 2010 .

[20]  James H. Lebovic Why Intelligence Fails: Lessons from the Iranian Revolution and the Iraq War. By Robert Jervis , 2010, Perspectives on Politics.

[21]  Oscar Garc ´ õa Thinking about Time , 2004 .

[22]  P. Tetlock,et al.  Social functionalist frameworks for judgment and choice: intuitive politicians, theologians, and prosecutors. , 2002, Psychological review.

[23]  George Ross Fisher,et al.  Death of the Guilds: Professions, States, and the Advance of Capitalism, 1930 to the Present , 1996 .

[24]  Frank C Keil,et al.  WHEN AND WHY DO HEDGEHOGS AND FOXES DIFFER? , 2010, Critical review.

[25]  T. Mann The Black Swan , 1954 .

[26]  P. Tetlock,et al.  Counterfactual Thought Experiments in World Politics Logical, Methodological, and Psychological Perspectives , 1996 .

[27]  Ian S. Lustick TETLOCK AND COUNTERFACTUALS: SAVING METHODOLOGICAL AMBITION FROM EMPIRICAL FINDINGS , 2010 .

[28]  Harold L. Wilensky,et al.  The Professionalization of Everyone? , 1964, American Journal of Sociology.

[29]  S. Huffmon Expert Political Judgment: How Good Is It? How Can We Know? , 2006 .