Dialogue as Medium (and Message) for Training Critical Thinking

Standard internalist approaches to critical thinking insist that critical thinkers maintain conscious, deliberate access to the reasons for their beliefs and actions. A more useful approach is externalist, focusing on the reliability of different types of processes for generating beliefs and decisions under different circumstances. We describe an externalist approach to critical thinking based on dialogue. According to the theory, critical thinking is asking and answering questions about alternative possibilities in order to achieve some objective. Three perspectives are coordinated (by different individuals or inside a single head): a proponent, an opponent, and a referee. By asking and answering questions, the defender and challenger introduce new possibilities (mental models), understand them more completely, and learn one another’s beliefs and preferences. The referee, who represents an external perspective, regulates the dialogue so that it reliably achieves the participants’ objectives within the available time. "Critical Thinking through Dialogue" training takes trainees through four phases of a critical dialogue (identifying a disagreement, deciding how to resolve it, challenging and defending positions, and resolution), and presents principles associated with each phase. Tactical decision game scenarios were used prior to training, for practice, and for a post-training test. The training led participants to surface information not previously shared and to make effective use of it. They were more likely to recognize and deal with disagreements, to ask for and give reasons for positions, listen more carefully, and seek creative solutions rather than premature compromises. Current work is extending the theory and training to leadership skills. Dialogue and Critical Thinking 3 Approaches To Critical Thinking Definitions of critical thinking vary, but most share a common theme. Siegel (1997, p.14), for example, says that ...being a critical thinker requires basing one’s beliefs and actions on reasons... the beliefs and actions of the critical thinker, at least ideally, are justified by reasons for them which she has properly evaluated [italics in original]. Paul (1993) defines critical thinking as “a unique kind of purposeful thinking in which the thinker systematically and habitually imposes criteria and intellectual standards upon the thinking....” Implicit or explicit in many definitions (Johnson, 1996, chpt. 12) is that critical thinking involves the deliberate application of a proper evaluative criterion directly to beliefs and decisions and the reasons for arriving at them. These definitions (and many others; see Cohen, Salas, & Riedel, 2002, for a review) reflect a particular paradigm. Critical thinking has traditionally been conceptualized from an internalist point of view, which (as the name suggests) packs everything relevant to the evaluation of an intellectual product into the consciousness of an individual (Feldman & Conee, 2000; Plantinga, 1993a, pp. 3-29). From this perspective, it is inappropriate to credit a person for a correct judgment or decision if she cannot justify it by an explicit reason. If she cannot say why she judged or decided in the way she did, then she got it right by accident (P. Klein, 2000). Expert physicians who are unable to explain a diagnosis (Patel, Arocha, & Kaufman, 1999, p. 82) are irrational, or at the very least cannot be good critical thinkers. By the same token, there is a set of rules for proper reasoning that applies to all situations at all times; if adoption of a belief fits those rules, it cannot be faulted, no matter else is going on. For example, it is unfair to fault a judgment or decision by reference to information of Dialogue and Critical Thinking 4 which the person was unaware, even if readily available, or based on other rules, which are not intuitively compelling to that person. The purpose of this evaluation is “fairness” rather than effectiveness. As a consequence, critical thinking is supposed to evaluate a static, self-contained set of mental contents, in the light of universally compelling standards (e.g., logical, probabilistic, or decision theoretic) that specify how conclusions should be supported by reasons. Sosa (1991, p. 195) dubbed this view the “intellectualist model of justification.” A problem with internalism is that only a small subset of the reasons for a decision can ever be made explicit in critical thinking (Cherniak, 1986). As a result, the required absolute evaluative criteria do not exist. To varying degrees, everyone is in the same boat as the inarticulate expert physicians. Another problem is that, if applied “systematically and habitually” (e.g., as urged by Paul; also, Siegel, 1997: p. 16), the habit of asking for reasons leads to an infinite regress; to be a critical thinker is to be on a never-ending treadmill. Questions arise about the potential usefulness of training such skills for use in real-world domains like the Army tactical battlefield: Will critical thinking take too much time, undermine the will to fight, supplant experience and even expertise, stifle innovation, or disrupt coordination? Unfortunately, the current state of the field does not provide encouraging answers. Critical thinking textbooks tend to emphasize (i) basing judgments and decisions on formal or informal logic, probability theory, or decision theory, and (ii) the avoidance of common fallacies (Hansen & Pinto, 1995) and biases (e.g, Kahneman, Slovic, & Tversky, 1982). Critical thinking is still regarded implicitly as a form of inner purity. The critical thinker’s duty is to accept only beliefs seen clearly to follow from sound arguments, regardless of conditions or outcomes in the real world. There is little prescriptive research regarding pragmatic constraints on critical thinking that arise in time-sensitive domains. Dialogue and Critical Thinking 5 Our objective was to place critical thinking in a more realistic context for practitioners. To accomplish this, we sought a conceptualization that would: – Capture the idea of thinking about thinking without demanding that all (or even most) decision making be deliberative, or that all (or even most) reasons be made explicit. – Be usable in time-constrained situations. – Take account of constraints & obstacles due to social and organizational relationships. – Enhance the effectiveness of strategies actually used by proficient decision makers (e.g., recognition, story-building). – Be easy to teach, practice, and evaluate in real-world contexts. These objectives commit us to an externalist point of view (e.g., Papineau, 2003; Lipshitz & Cohen, 2003). From that perspective, evaluation is based on the reliability of the process that generated a judgment or a decision in real-world environments of the appropriate kind. Critical thinking has a different look and status in the externalist perspective: (i) Externalist evaluation is highly context-dependent, and the most effective processes or methods are often domain-specific rather than general. A judgment or decision is justified if it is generated by a process that reliably achieves objectives under relevant conditions (Goldman, 1992, chpt. 6). (ii) Reasons for a belief or decision will be spelled out to varying degrees depending on the context, and there will always be a large residual dependence on the reliability of relatively automatic perceptual and inferential processes (e.g., rapid recognition-primed decision making; Klein, 1993). (iii) Evaluation based on effectiveness (rather than “fairness”) is not limited to a person’s consciousness. Cognitive and social processes that expose views to outside challenge or actively seek information from the environment are likely to increase reliability (Goldman, 1992, chpt. 10) and may be part of critical thinking. (iv) Feasibility is built into the notion of reliability. Dialogue and Critical Thinking 6 Externalist criteria will favor strategies that are closely related to the way people already think over methods that are formally rigorous but impossible to implement (Lipshitz & Cohen, 2003). (v) No single method or process defines rationality. Critical thinking itself is not necessary for rationality, since intuitive or recognitional processes may be more reliable for achieving goals in familiar situations or when time is limited (Cohen, Freeman, & Wolf, 1996). At the other extreme, formal models might be worthwhile when their presuppositions are satisfied and an explicit computational implementation is available. Is there an externalist platform for critical thinking that realizes our objectives? Dialogue and Thought We propose an externalist perspective according to which critical thinking is, in essence, a form of dialogue. Dialogue theory studies reasoning and decision making as they actually occur in multiperson interactions rather than as a static set of logically related premises and conclusions (Hamblin, 1970; Rescher, 1977; van Eemeren & Grootendorst, 1983; van Eemeren et al., 1993). It seeks to identify the different types of argumentation (that is, the dynamic exchange of reasons for and against a conclusion) that are observed in conversation and the kinds of errors to which they are subject. Walton (1995, 1998) generalized the notion of dialogue beyond argumentation, defining it as any characteristic type of multiperson exchange with associated mutual expectations about roles, constraints, and purposes (Walton, 1998; Walton & Krabbe, 1995, p. 66). Based on that definition, he developed a classification of dialogue types, including negotiation, deliberation, inquiry, information seeking, and even quarreling. Dialogue theory blends descriptive and normative concerns, beginning in bottom up fashion with real-world conversations. Researchers start with observed types of interactive exchange and then build idealized models. These models constrain how each type of transaction should be Dialogu

[1]  Daniel J. Garland,et al.  Situation Awareness Analysis and Measurement , 2009 .

[2]  Glen Whyte,et al.  Collective efficacy and vigilant problem solving in group decision making: A non-linear model , 2005 .

[3]  Marvin S. Cohen,et al.  Warrants for Prescription: Analytically and Empirically Based Approaches to Improving Decision Making , 2005, Hum. Factors.

[4]  Jonathan Potter,et al.  Conversation and Cognition: Acknowledgements , 2005 .

[5]  P. Johnson-Laird,et al.  Reasoning from inconsistency to consistency. , 2004, Psychological review.

[6]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[7]  Bart Verheij,et al.  Douglas Walton, The New Dialectic. Conversational Contexts of Argument. Toronto: University of Toronto Press (Book Review) , 2001, Artificial Intelligence and Law.

[8]  Verlin B. Hinsz,et al.  Metacognition and mental models in groups: An illustration with metamemory of group recognition memory. , 2004 .

[9]  D. Papineau The Roots of Reason: Philosophical Essays on Rationality, Evolution, and Probability , 2003 .

[10]  Bryan B. Thompson,et al.  6. Training teams to take initiative: Critical thinking in novel situations , 2001 .

[11]  Robert Levy,et al.  Epistemology: An Anthology , 2001 .

[12]  Alan Garnham,et al.  Mental models and the interpretation of anaphora , 2001 .

[13]  N. Rescher Cognitive Pragmatism: The Theory of Knowledge in Pragmatic Perspective , 2001 .

[14]  G. Shafer Nature’s Possibilities and Expectations , 2001 .

[15]  Kenneth R. Hammond,et al.  Human Judgment and Social Policy: Irreducible Uncertainty, Inevitable Error, Unavoidable Injustice , 2000 .

[16]  Nancy J. Cooke,et al.  Measuring Team Knowledge , 2000, Hum. Factors.

[17]  Nancy Pennington,et al.  Explanation-based decision making. , 2000 .

[18]  Ernest Sosa,et al.  Epistemology : an anthology , 2000 .

[19]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[20]  Gerd Gigerenzer,et al.  Adaptive Thinking: Rationality in the Real World , 2000 .

[21]  C. Habel,et al.  Mental Models in Discourse Processing and Reasoning , 1999 .

[22]  J. Levine,et al.  Shared Cognition in-Organizations: The Management of Knowledge , 1999 .

[23]  Vimla L. Patel,et al.  Expertise and Tacit Knowledge in Medicine , 1999 .

[24]  Garold Stasser,et al.  The uncertain role of unshared information in collective choice. , 1999 .

[25]  M. Tomasello The Cultural Origins of Human Cognition , 2000 .

[26]  Wolfgang Schnotz,et al.  Task-dependent construction of mental models as a basis for conceptual change , 1997 .

[27]  G. Rickheit,et al.  1 Mental Models: Some answers, some questions, some suggestions , 1999 .

[28]  Philip N. Johnson-Laird,et al.  Naive Probability: A Mental Model Theory of Extensional Reasoning , 1999 .

[29]  P. Johnson-Laird,et al.  13 Mental models in deductive, modal, and probabilistic reasoning , 1999 .

[30]  Ronald W. Langacker,et al.  Grammar and conceptualization , 1999 .

[31]  Jaakko Hintikka,et al.  Inquiry as Inquiry: A Logic of Scientific Discovery , 1999 .

[32]  Douglas Walton,et al.  The New Dialectic: Conversational Contexts of Argument , 1998 .

[33]  Sam Wineburg,et al.  Reading Abraham Lincoln: An Expert/Expert Study in the Interpretation of Historical Texts , 1998, Cogn. Sci..

[34]  Gary Klein Sources of Power , 1998 .

[35]  H. Simon Models of Bounded Rationality: Empirically Grounded Economic Reason , 1997 .

[36]  Allen C. Amason,et al.  The effects of conflict on strategic decision making effectiveness and organizational performance. , 1997 .

[37]  K. Jehn Affective and cognitive conflict in work groups: Increasing performance through value-based intragroup conflict. , 1997 .

[38]  Reid Hastie,et al.  The impact of information on small group choice. , 1997 .

[39]  H. Siegel Rationality Redeemed?: Further Dialogues on an Educational Ideal , 1996 .

[40]  Douglas Walton,et al.  Argument Structure: A Pragmatic Theory , 1996 .

[41]  Gary Katzenstein,et al.  The Debate on Structured Debate: Toward a Unified Theory , 1996 .

[42]  Allen C. Amason Distinguishing the Effects of Functional and Dysfunctional Conflict on Strategic Decision Making: Resolving a Paradox for Top Management Teams , 1996 .

[43]  Jonathan Evans,et al.  Rationality and reasoning , 1996 .

[44]  Ralph H. Johnson The rise of informal logic: Essays on argumentation , 1996 .

[45]  B. Koslowski Theory and Evidence: The Development of Scientific Reasoning , 1996 .

[46]  Marvin S. Cohen,et al.  Metarecognition in Time-Stressed Decision Making: Recognizing, Critiquing, and Correcting , 1996, Hum. Factors.

[47]  J. Mcdowell,et al.  Knowledge and the Social Articulation of the Space of Reasons@@@Knowledge and the Internal. , 1995 .

[48]  D. Walton A Pragmatic Theory of Fallacy , 1995 .

[49]  H. Hansen,et al.  Fallacies: Classical and Contemporary Readings , 1995 .

[50]  E. Hutchins Cognition in the wild , 1995 .

[51]  D. Walton,et al.  Commitment in Dialogue: Basic Concepts of Interpersonal Reasoning , 1995 .

[52]  D. Walton Argumentation Schemes for Presumptive Reasoning , 1995 .

[53]  Philip N. Johnson-Laird,et al.  Reasoning and decision making , 1994 .

[54]  S. Jackson,et al.  Reconstructing Argumentative Discourse , 1993 .

[55]  N. Pennington,et al.  Reasoning in explanation-based decision making , 1993, Cognition.

[56]  T. Connolly,et al.  The reinvention of decision making. , 1993 .

[57]  Alvin Plantinga,et al.  Warrant: The Current Debate , 1993 .

[58]  H. H. Clark Arenas of language use , 1993 .

[59]  G. Klein,et al.  Decision Making in Action: Models and Methods , 1993 .

[60]  E. Salas,et al.  Shared mental models in expert team decision making. , 1993 .

[61]  Alvin Plantinga Warrant and proper function , 1993 .

[62]  Judith Orasanu,et al.  DECISION-MAKING IN THE COCKPIT. , 1993 .

[63]  G. Klein,et al.  A recognition-primed decision (RPD) model of rapid decision making. , 1993 .

[64]  T. Wilkerson Knowledge in Perspective. Selected Essays in Epistemology , 1992 .

[65]  F. H. Eemeren,et al.  Argumentation, Communication, and Fallacies: A Pragma-dialectical Perspective , 1992 .

[66]  T. O. Nelson Metacognition : core readings , 1992 .

[67]  J. Shanteau The Psychology of Experts An Alternative View , 1992 .

[68]  Alvin I. Goldman,et al.  Liaisons: Philosophy Meets the Cognitive and Social Sciences , 1991 .

[69]  R. Paul,et al.  Critical Thinking: What Every Person Needs To Survive in a Changing World , 1991 .

[70]  B. Rogoff Apprenticeship in Thinking: Cognitive Development in Social Context , 1990 .

[71]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[72]  D. Walton,et al.  Fallacies : Selected Papers 1972-1982 , 1989 .

[73]  Charles R. Schwenk,et al.  A meta‐analysis on the comparative effectiveness of devil's advocacy and dialectical inquiry , 1989 .

[74]  D. Over,et al.  Studies in the Way of Words , 1989 .

[75]  Circularity, Non-Linear Justification and Holistic Coherentism , 1989 .

[76]  N. Pennington,et al.  Explanation-based decision making: effects of memory structure on judgment , 1988 .

[77]  T. Govier Problems in Argument Analysis and Evaluation , 2018 .

[78]  Rob Grootendorst,et al.  Argumentation : Perspectives and Approaches , 1987 .

[79]  G. Gigerenzer,et al.  Cognition as Intuitive Statistics , 1987 .

[80]  Penelope Brown,et al.  Politeness: Some Universals in Language Usage , 1989 .

[81]  Johan de Kleer,et al.  An Assumption-Based TMS , 1987, Artif. Intell..

[82]  A. Goldman Epistemology and Cognition , 1986 .

[83]  D. Sperber,et al.  Relevance: Communication and Cognition , 1997 .

[84]  D. Schweiger,et al.  Group Approaches for Improving Strategic Decision Making: A Comparative Analysis of Dialectical Inquiry, Devil's Advocacy, and Consensus , 1986 .

[85]  Christopher Cherniak,et al.  Minimal Rationality , 1986, Computational models of cognition and perception.

[86]  T. Govier A practical study of argument , 1985 .

[87]  Gilles Fauconnier,et al.  Mental Spaces: Aspects of Meaning Construction in Natural Language , 1985 .

[88]  F. H. Eemeren,et al.  Speech acts in argumentative discussions , 1984 .

[89]  P. Johnson-Laird Mental models , 1989 .

[90]  A. Tversky,et al.  Intuitive Prediction: Biases and Corrective Procedures , 1982 .

[91]  Drew McDermott,et al.  Non-Monotonic Logic I , 1987, Artif. Intell..

[92]  Charles R. Schwenk,et al.  Effects of the expert, devil's advocate, and dialectical inquiry methods on prediction performance , 1980 .

[93]  Philip N. Johnson-Laird,et al.  Mental Models in Cognitive Science , 1980, Cogn. Sci..

[94]  Jan Mukařovský Structure, sign, and function : selected essays , 1981 .

[95]  N. Rescher Methodological Pragmatism: A Systems-Theoretic Approach to the Theory of Knowledge , 1977 .

[96]  Nicholas Rescher,et al.  Dialectics: A Controversy-Oriented Approach to the Theory of Knowledge , 1977 .

[97]  J. A. Blair,et al.  Logical Self-Defense , 1977 .

[98]  Richard D. Rieke,et al.  Argumentation and critical decision making , 1975 .

[99]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[100]  H. Simon,et al.  Perception in chess , 1973 .

[101]  P. Johnson-Laird,et al.  Psychology of Reasoning: Structure and Content , 1972 .

[102]  Peter D. Klein A Proposed Definition of Propositional Knowledge , 1971 .

[103]  S. Engel,et al.  Thought and Language , 1964, Dialogue.

[104]  E. Brunswik Representative design and probabilistic theory in a functional psychology. , 1955, Psychological review.

[105]  G. Mead Mind, Self, and Society: From the Standpoint of a Social Behaviorist (Works of George Herbert Mead, Vol. 1) , 1934 .