Interactive Instruction in Bayesian Inference

An instructional approach is presented to improve human performance in solving Bayesian inference problems. Starting from the original text of the classic Mammography Problem, the textual expression is modified and visualizations are added according to Mayer’s principles of instruction. These principles concern coherence, personalization, signaling, segmenting, multimedia, spatial contiguity, and pretraining. Principles of self-explanation and interactivity are also applied. Four experiments on the Mammography Problem showed that these principles help participants answer the questions at significantly improved rates. Nonetheless, in novel interactivity conditions, performance was lowered suggesting that more interaction can add more difficulty for participants. Overall, a leap forward in accuracy was found, with more than twice the participant accuracy of previous work. This indicates that an instructional approach to improving human performance in Bayesian inference is a promising direction.

[1]  R. Mayer,et al.  Cognitive constraints on multimedia learning: When presenting more material results in less understanding. , 2001 .

[2]  Alan J. Dix,et al.  Starting simple: adding value to static visualisation through simple interaction , 1998, AVI '98.

[3]  V. Girotto,et al.  Solving probabilistic and statistical problems: a matter of information structure and question form , 2001, Cognition.

[4]  Pierre Dragicevic,et al.  Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[5]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[6]  Gary L. Brase,et al.  Frequency interpretation of ambiguous statistical information facilitates Bayesian reasoning , 2008, Psychonomic bulletin & review.

[7]  Simon Breslav,et al.  Mimic: visual analytics of online micro-interactions , 2014, AVI.

[8]  Richard E. Mayer,et al.  Cognitive Theory of Multimedia Learning , 2021, The Cambridge Handbook of Multimedia Learning.

[9]  Ruth Beyth-Marom,et al.  The effects of mental steps and compatibility on Bayesian reasoning , 2014, Judgment and Decision Making.

[10]  Nicola J. Gibbons,et al.  The interactivity effect in multimedia learning , 2007, Comput. Educ..

[11]  Jonathan Evans,et al.  Frequency versus probability formats in statistical word problems , 2000, Cognition.

[12]  Ruth Wylie,et al.  The Self-Explanation Principle in Multimedia Learning , 2014 .

[13]  George W. Fitzmaurice,et al.  Spotlight: directing users' attention on large displays , 2005, CHI.

[14]  Jennifer Tsai,et al.  Interactive Visualizations to Improve Bayesian Reasoning , 2011 .

[15]  Alvitta Ottley,et al.  Visually Communicating Bayesian Statistics to Laypersons , 2012 .

[16]  Stephen K. Reed,et al.  Cognitive Architectures for Multimedia Learning , 2006 .

[17]  David R. Mandel,et al.  The psychology of Bayesian reasoning , 2014, Front. Psychol..

[18]  R. Mayer.  Applying the science of learning: evidence-based principles for the design of multimedia instruction. , 2008, The American psychologist.

[19]  William G. Cole,et al.  Understanding Bayesian reasoning via graphical displays , 1989, CHI '89.

[20]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[21]  Simon Breslav,et al.  Benefits of visualization in the Mammography Problem , 2015, Int. J. Hum. Comput. Stud..

[22]  Fred Paas,et al.  Instructional efficiency of animation: effects of interactivity through mental reconstruction of static key frames , 2007 .

[23]  Russell Revlin,et al.  Deduction with Euler Circles: Diagrams That Hurt , 2006, Diagrams.

[24]  Jan L. Plass,et al.  Interactivity in multimedia learning: An integrated model , 2010, Comput. Hum. Behav..

[25]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[26]  D. Eddy.  Judgment under uncertainty: Probabilistic reasoning in clinical medicine: Problems and opportunities , 1982 .

[27]  Daniel Afergan,et al.  Improving Bayesian Reasoning: The Effects of Phrasing, Visualization, and Spatial Ability , 2016, IEEE Transactions on Visualization and Computer Graphics.

[28]  Lorrie Faith Cranor,et al.  Are your participants gaming the system?: screening mechanical turk workers , 2010, CHI.

[29]  Min Liu,et al.  The impact of animation interactivity on novices' learning of introductory statistics , 2011, Comput. Educ..

[30]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[31]  W. Casscells,et al.  Interpretation by physicians of clinical laboratory results. , 1978, The New England journal of medicine.

[32]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .