The probabilistic reasoning in “real-world” context: some reflections about the judgement in medical problem solving

This work aims to assess the probabilistic reasoning applied in the “real-world” context, specifically referring to the judgement in medical problem solving, applied by unexperienced individuals. It was carried out a mixed methods approach, in which data collected by quantitative methods was integrated with data collected in qualitative method. The open response to the probabilistic medical problem was assessed and classified using the structure of the observed learning outcome (SOLO) taxonomy. This assessment was associated with quantitative data related to the correctness of the response, with the confidence in the response, and with numerical and visuospatial abilities assessed using Thurstone’s Primary Mental Abilities (PMA) scales. The data were collected while administering the problem to 352 Italian undergraduates in psychology, who had no statistical knowledge. Few individuals gave the correct answer and few applied high levels of reasoning. Furthermore, many exhibited low levels of confidence in the correctness of their responses. It was found that the participants often applied avoidance strategies. The implications of these findings with respect to applied perspectives will be discussed.

[1]  Murad Jurdak,et al.  Trends in the development of student level of reasoning in pattern generalization tasks across grade level , 2014 .

[2]  Lazar Stankov,et al.  Noncognitive predictors of intelligence and academic achievement : An important role of confidence , 2013 .

[3]  Alessandro Antonietti,et al.  What are judgment skills in health literacy? A psycho-cognitive perspective of judgment and decision-making research , 2015, Patient preference and adherence.

[4]  Mark Wilson,et al.  Using the concept of a measurement system to characterize measurement models used in psychometrics , 2013 .

[5]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[6]  Rocio Garcia-Retamero,et al.  Improving risk literacy in surgeons. , 2016, Patient education and counseling.

[7]  Luca Mari,et al.  Beyond the representational viewpoint: a new formalization of measurement , 2000 .

[8]  Jakub Traczyk,et al.  Numeracy moderates the influence of task-irrelevant affect on probability weighting , 2016, Cognition.

[9]  Mirian Agus,et al.  Towards the development of problems comparing verbal-numerical and graphical formats in statistical reasoning , 2015 .

[10]  Alessandro Antonietti,et al.  Simple heuristics in over-the-counter drug choices: a new hint for medical education and practice , 2011, Advances in medical education and practice.

[11]  David E. Over,et al.  Probabilities, beliefs, and dual processing: the paradigm shift in the psychology of reasoning , 2012 .

[12]  E. Diener,et al.  Handbook of Multimethod Measurement in Psychology , 2005 .

[13]  Sachi Nandan Mohanty,et al.  Decision Making under Uncertainty and Information Processing in Positive and Negative Mood States , 2014, Psychological reports.

[14]  Valerie A. Thompson,et al.  Intuition, reason, and metacognition , 2011, Cognitive Psychology.

[15]  Donald E. Stanley,et al.  The Logic of Medical Diagnosis: Generating and Selecting Hypotheses , 2019 .

[16]  William P. Fisher,et al.  Metrology, Psychometrics, and New Horizons for Innovation , 2017 .

[17]  Traci Mann,et al.  Dispositional motivations and message framing: a test of the congruency hypothesis in college students. , 2004, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[18]  Gerd Gigerenzer,et al.  Statistical Thinking: No One Left Behind , 2014 .

[19]  Lazar Stankov,et al.  Confidence: the best non-cognitive predictor of academic achievement? , 2014 .

[20]  Andrea L. Taylor,et al.  “Thinking about Numbers Is Not My Idea of Fun” , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.

[21]  Georg Bruckmaier,et al.  Effects of visualizing statistical information – an empirical study on tree diagrams and 2 × 2 tables , 2015, Front. Psychol..

[22]  David Reed The use of ill-defined problems for developing problem-solving and empirical skills in CS1 , 2002 .

[23]  Baruch Fischhoff,et al.  Explaining adult age differences in decision‐making competence , 2012 .

[24]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[25]  Mirian Agus,et al.  The use of imagery in statistical reasoning by university undergraduate students: a preliminary study , 2014 .

[26]  Gregory Schraw,et al.  Cognitive processes in well‐defined and ill‐defined problem solving , 1995 .

[27]  R W Batterham,et al.  Health literacy: applying current concepts to improve health services and reduce health inequalities. , 2016, Public health.

[28]  Mokaeane V. Polaki,et al.  Dealing with Compound Events , 2005 .

[29]  G. Gigerenzer On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky (1996) , 1996 .

[30]  Norjoharuddeen Mohd Nor,et al.  Assessing Students\' Informal Inferential Reasoning using SOLO Taxonomy based Framework. , 2010 .

[31]  A. Agresti An introduction to categorical data analysis , 1997 .

[32]  Maribel Peró,et al.  Factors Related to the Academic Performance of Students in the Statistics Course in Psychology , 2006 .

[33]  Dewi Retno Sari Saputro,et al.  How to Analyze the Students’ Thinking Levels Based on SOLO Taxonomy? , 2017 .

[34]  Mimi Bong,et al.  Multitrait–Multimethod Designs , 2010 .

[35]  Edward T. Cokely,et al.  The Influence of Skills, Message Frame, and Visual Aids on Prevention of Sexually Transmitted Diseases , 2014 .

[36]  K. Perreault,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2011 .

[37]  B. Bornstein,et al.  Rationality in medical decision making: a review of the literature on doctors' decision-making biases. , 2001, Journal of evaluation in clinical practice.

[38]  Mirian Agus,et al.  Assessing probabilistic reasoning in verbal-numerical and graphical-pictorial formats: An evaluation of the psychometric properties of an instrument , 2016 .

[39]  William P. Fisher,et al.  A Practical Approach to Modeling Complex Adaptive Flows in Psychology and Social Science , 2017 .

[40]  Kathleen D. Vohs,et al.  Making choices impairs subsequent self-control: A limited-resource account of decision making, self-regulation, and active initiative. , 2014 .

[41]  Mirian Agus,et al.  Investigating the probabilistic reasoning in verbal–numerical and graphical–pictorial formats in relation to cognitive and non-cognitive dimensions: The proposal of a model , 2016 .