The effects of multimedia on cognitive aspects of decision-making

Businesses make multimedia presentations, combining film clips and text, which could be made at less cost using a single medium. Extending prior findings that film clips in multimedia presentations can impact affective states (e.g., [Rose J. Behavioral decision aid research: Decision aid use and effects. In Arnold and Sutton, Research Accounting as an Information Systems Discipline (ch 6). Sarasota: AAA; 2002]), our study examines how multimedia presentations affect decision-making cognitively (rather than affectively). Participants performed two types of tasks using information presented to them in two single medium modes (text-only and film-only) and a multimedia mode (combined text/film). Based on theories of presentation modes/modalities, media richness, and information overload research, we hypothesize the effects of different presentation modes (single medium versus multimedia), task familiarity (familiar versus unfamiliar), and information overload (above versus below overload) on decision-makers' consistency with, compliance with, and willingness to apply externally provided information processing rules concerning the solving of various types of tasks. Results provide full to partial support for the predicted effects of task familiarity and information overload on consistency, compliance and willingness. Specifically, multimedia presentations increase the willingness to apply externally provided rules but decrease the consistency with which rules are applied to tasks. Overall, our study suggests that decision-makers are reluctant to use externally provided instructions, instead of their own internally learned rules, especially as their understanding of the task at hand increases. Such understanding is enhanced by high task familiarity, clear presentation formats (i.e., single medium), and low information load. This study has implications for businesses trying to decide how much to invest in multimedia presentations, and also on organizations and society at large as they frequently direct individuals to follow various types of instructions.

[1]  J. Patell,et al.  The Experimental Design of Classification Models: An Application of Recursive Partitioning and Bootstrapping to Commercial Bank Loan Classifications , 1984 .

[2]  S. Mckinstry.  Designing the annual reports of Burton plc from 1930 to 1994 , 1996 .

[3]  David N. Ricchiute.  Presentation mode, task importance, and cue order in experimental research on expert judges. , 1985 .

[4]  C. Penney.  Modality effects and the structure of short-term verbal memory , 1989, Memory & cognition.

[5]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[6]  P. Chandler,et al.  Cognitive load as a factor in the structuring of technical material. , 1990 .

[7]  D. L. Flesher,et al.  Pictures and the bottom line: The television epistemology of U.S. annual reports☆ , 1996 .

[8]  Robert H. Ashton,et al.  Human Information Processing in Accounting , 1982 .

[9]  David N. Ricchiute.  An Empirical-Assessment Of The Impact Of Alternative Task Presentation Modes On Decision-Making Research In Auditing , 1984 .

[10]  Donald R. Jones,et al.  The effects of attitudinal ambivalence and exploratory switching behavior on the use of two decision aids , 2006, Int. J. Account. Inf. Syst..

[11]  S. Gelman,et al.  Mapping the Mind: Domain Specificity In Cognition And Culture , 1994 .

[12]  Robert Libby,et al.  Determinants of judgment performance in accounting settings: Ability, knowledge, motivation , 1993 .

[13]  Mark T. Keane,et al.  Cognitive Psychology: A Student's Handbook , 1990 .

[14]  Dan Sperber,et al.  In defense of massive modularity , 2001 .

[15]  L. Cosmides,et al.  Mapping the mind: Origins of domain specificity: The evolution of functional organization , 1994 .

[16]  D. Schacter.  The seven sins of memory. Insights from psychology and cognitive neuroscience. , 1999, The American psychologist.

[17]  Chitra Dorai,et al.  Challenges of Business Media , 2004, IEEE Multim..

[18]  Richard L. Daft,et al.  Message Equivocality, Media Selection, and Manager Performance: Implications for Information Systems , 1987, MIS Q..

[19]  Stephen J. Hoch,et al.  A psychological approach to decision support systems , 1996 .

[20]  G. Keppel,et al.  Design and Analysis: A Researcher's Handbook , 1976 .

[21]  Richard L. Daft,et al.  Organizational information requirements, media richness and structural design , 1986 .

[22]  Daniel David,et al.  The information-processing approach to the human mind: Basics and beyond. , 2004, Journal of clinical psychology.

[23]  L. Jacoby.  A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[24]  Jacob M. Rose.  The effects of multimedia-induced affective states on recall and decision-making by individual investors , 2001, Int. J. Account. Inf. Syst..

[25]  Donald R. Jones,et al.  Understanding and attenuating decision bias in the use of model advice and other relevant information , 2006, Decis. Support Syst..

[26]  Jonathan J. Hull,et al.  Refocusing Multimedia Research on Short Clips , 2005, IEEE Multim..

[27]  Izak Benbasat,et al.  The Influence of Multimedia on Improving the Comprehension of Organizational Information , 2002, J. Manag. Inf. Syst..

[28]  H. Arkes,et al.  Factors influencing the use of a decision rule in a probabilistic task , 1986 .

[29]  R. Daft,et al.  Information Richness. A New Approach to Managerial Behavior and Organization Design , 1983 .

[30]  Robert Libby,et al.  Accounting and human information processing : theory and applications , 1981 .

[31]  Douglas E. Shook,et al.  RELATIONSHIPS OF JOB CATEGORIES AND ORGANIZATIONAL LEVELS TO USE OF COMMUNICATION CHANNELS, INCLUDING ELECTRONIC MAIL: A META-ANALYSIS AND EXTENSION* , 1990 .

[32]  Anna M. Rose,et al.  Affective responses to financial data and multimedia: the effects of information load and cognitive load , 2004, Int. J. Account. Inf. Syst..

[33]  Kil-Soo Suh,et al.  Impact of communication medium on task performance and satisfaction: an examination of media-richness theory , 1999, Inf. Manag..

[34]  Emmanuel Dupoux.  Language, brain, and cognitive development : essays in honor of Jacques Mehler , 2001 .

[35]  Brad M. Tuttle,et al.  The effects of a modest incentive on information overload in an investment analysis task , 1999 .

[36]  Morris H. Stocks,et al.  The impact of an increase in accounting information level on the judgment quality of individuals and groups , 1995 .