The effects of decision aid structural restrictiveness on cognitive load, perceived usefulness, and reuse intentions

As accounting environments become increasingly automated through information technology support systems, the underlying systems are increasingly restrictive in an effort to direct user behavior and decision making. However, consistent with the theory of technology dominance, restrictive systems have been found to dominate users' decision processes and to have a detrimental effect when decisions require knowledge from outside the system's capability. This study expands upon this research through an examination of users' preferences for more (less) restrictive systems based on their own level of domain knowledge. Incorporating theory on task technology fit, we theorize that users with less knowledge will prefer to be dominated by the system, while users with greater levels of knowledge will prefer a system that provides the user with a level of control over the decision process rather than submitting entirely to the decision aid's control. These theorizations are empirically tested through an experimental design that varies the level of systems restrictiveness across groups of novice and experienced participants. The results confirm that novice (experienced) participants find a highly restrictive system substantially (minimally) reduces cognitive load, increases (decreases) usefulness of the decision aid, and strengthens (weakens) the intention to reuse the system in the future. The results add an important piece to understanding the effect of restrictive systems in that the users that are most susceptible to dominance by decision aids are the users most willing to adopt a restrictive system that reduces the effort they must put forth and in turn reduces the knowledge they accrue from using the system.

[1]  Vicky Arnold,et al.  Impact of intelligent decision aids on expert and novice decision-makers' judgments , 2004 .

[2]  Izak Benbasat,et al.  Interactive Decision Aids for Consumer Decision Making in E-Commerce: The Influence of Perceived Strategy Restrictiveness , 2009, MIS Q..

[3]  Arnold M. Wright,et al.  The Effectiveness of Alternative Risk Assessment and Program Planning Tools in a Fraud Setting , 2004 .

[4]  Rajiv D. Banker,et al.  Impact of Information Technology on Public Accounting Firm Productivity , 2002, J. Inf. Syst..

[5]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[6]  Robert Fildes,et al.  Restrictiveness and guidance in support systems , 2011 .

[7]  Bernadette Szajna,et al.  Empirical evaluation of the revised technology acceptance model , 1996 .

[8]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[9]  Mary B. Curtis,et al.  An examination of contextual factors and individual characteristics affecting technology implementation decisions in auditing , 2008, Int. J. Account. Inf. Syst..

[10]  Jacqueline L. Reck,et al.  Decision Aid Reliance: A Longitudinal Field Study Involving Professional Buy-Side Financial Analysts* , 2010 .

[11]  Peter A. Todd,et al.  Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication , 1992, MIS Q..

[12]  C. J. Wolfe,et al.  Why Wait? Modeling Factors that Influence the Decision of When to Learn a New Use of Technology , 2006, J. Inf. Syst..

[13]  Pamela J. Wisniewski,et al.  When more is too much: Operationalizing technology overload and exploring its impact on knowledge worker productivity , 2010, Comput. Hum. Behav..

[14]  Magid Igbaria,et al.  Personal Computing Acceptance Factors in Small Firms: A Structural Equation Model , 1997, MIS Q..

[15]  Ilze Zigurs,et al.  A Theory of Task/Technology Fit and Group Support Systems Effectiveness , 1998, MIS Q..

[16]  Patrick R. Wheeler,et al.  The Effects of Decision Aid Design on the Information Search Strategies and Confirmation Bias of Tax Professionals , 2008 .

[17]  Robin R. Pennington,et al.  The Effects of Qualitative Overload on Technology Acceptance , 2006, J. Inf. Syst..

[18]  Kieran Mathieson,et al.  Predicting User Intentions: Comparing the Technology Acceptance Model with the Theory of Planned Behavior , 1991, Inf. Syst. Res..

[19]  Siew H. Chan A Motivational Framework For Understanding IS Use And Decision Performance , 2011, BIS 2011.

[20]  P. Chandler,et al.  Cognitive Load Theory and the Format of Instruction , 1991 .

[21]  Mark S. Silver,et al.  Decision Support Systems: Directed and Nondirected Change , 1990, Inf. Syst. Res..

[22]  D. Harrison McKnight,et al.  Perceived Information Quality in Data Exchanges: Effects on Risk, Trust, and Intention to Use , 2006, Inf. Syst. Res..

[23]  J. Brehm A theory of psychological reactance. , 1981 .

[24]  Stewart A. Leech,et al.  Audit Support Systems and Decision Aids: Current Practice and Opportunities for Future Research , 2007 .

[25]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[26]  Magid Igbaria,et al.  An examination of the factors contributing to microcomputer technology acceptance , 1994 .

[27]  C. Varey,et al.  Towards a Consensus on Overconfidence , 1996 .

[28]  D. Harrison McKnight,et al.  System Design Features and Repeated Use of Electronic Data Exchanges , 2011, J. Manag. Inf. Syst..

[29]  Stewart A. Leech,et al.  Audit Support System Design and the Declarative Knowledge of Long‐Term Users , 2008 .

[30]  Dennis F. Galletta,et al.  Factors Influencing the Planned Adoption of Continuous Monitoring Technology , 2012, J. Inf. Syst..

[31]  James E. Hunton,et al.  Incorporating information technology considerations into an expanded model of judgment and decision making in accounting , 2000, Int. J. Account. Inf. Syst..

[32]  Amy M. Hageman The role of confidence in tax return preparation using tax software , 2010 .

[33]  Vicky Arnold,et al.  The Impact of Embedded Intelligent Agents on Tax‐Reporting Decisions , 2002 .

[34]  Dennis F. Galletta,et al.  The antecedents of the use of continuous auditing in the internal auditing context , 2012, Int. J. Account. Inf. Syst..

[35]  Stewart A. Leech,et al.  A Big 4 Firm's Use of Information Technology to Control the Audit Process: How an Audit Support System is Changing Auditor Behavior , 2014 .

[36]  Andreas I. Nicolaou Integrated Information Systems and Interorganizational Performance: The Role of Management Accounting Systems Design , 2011 .

[37]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[38]  Jean C. Bedard,et al.  The effect of training on auditors' acceptance of an electronic work system , 2003, Int. J. Account. Inf. Syst..

[39]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[40]  Izak Benbasat,et al.  The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids , 2008, Decis. Sci..

[41]  Poh-Sun Seow,et al.  The Effects of Decision Aid Structural Restrictiveness on Decision-Making Outcomes , 2011, Int. J. Account. Inf. Syst..

[42]  Clark Hampton,et al.  Determinants of reliance: An empirical test of the theory of technology dominance , 2005, Int. J. Account. Inf. Syst..

[43]  Dale Goodhue,et al.  Task-Technology Fit and Individual Performance , 1995, MIS Q..

[44]  Andreas I. Nicolaou Adoption of just-in-time and electronic data interchange systems and perceptions of cost management systems effectiveness , 2002, Int. J. Account. Inf. Syst..

[45]  Vicky Arnold,et al.  Do tax decision support systems affect the accuracy of tax compliance decisions? , 2002, Int. J. Account. Inf. Syst..

[46]  David Y. Chan,et al.  Consequences of XBRL Standardization on Financial Statement Data , 2012, J. Inf. Syst..

[47]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[48]  Michael Mannino,et al.  Information technology acceptance in the internal audit profession: Impact of technology features and complexity , 2009, Int. J. Account. Inf. Syst..

[49]  Anna H. Nöteberg,et al.  Matching electronic communication media and audit tasks , 2003, Int. J. Account. Inf. Syst..

[50]  C. J. Wolfe,et al.  The effects of system design alternatives on the acquisition of tax knowledge from a computerized tax decision aid , 2000 .

[51]  M. W. Nelson,et al.  Using Decision Aids to Improve Auditors' Conditional Probability Judgments , 1998 .

[52]  Rebecca Graziani,et al.  Understanding Personal Mobile Technologies: Decomposing and De-Averaging the Value of a Smartphone , 2014, J. Inf. Syst..

[53]  Donald R. Deis,et al.  Risk Monitoring and Control in Audit Firms: A Research Synthesis , 2008 .

[54]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[55]  Izak Benbasat,et al.  Trust In and Adoption of Online Recommendation Agents , 2005, J. Assoc. Inf. Syst..

[56]  Jane M. Howell,et al.  Personal Computing: Toward a Conceptual Model of Utilization , 1991, MIS Q..

[57]  Paul Jen-Hwa Hu,et al.  The Effects of Process Accountability on Individuals' Use of a Familiar Technology , 2011, J. Inf. Syst..

[58]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[59]  Eric N. Wiebe,et al.  An examination of two mental workload measurement approaches to understanding multimedia learning , 2010, Comput. Hum. Behav..

[60]  James E. Hunton,et al.  Do Client‐Prepared Internal Control Documentation and Business Process Flowcharts Help or Hinder an Auditor's Ability to Identify Missing Controls? , 2009 .

[61]  Maureen Francis Mascha,et al.  Can computerized decision aids do "damage"? A case for tailoring feedback and task complexity based on task experience , 2007, Int. J. Account. Inf. Syst..