A review on objective measurement of usage in technology acceptance studies

Abstract This paper reviews objective measurement of usage in user acceptance studies using the technology acceptance model (TAM). The use of objective measurement is quite uncommon in TAM. In addition to its low frequency, another striking phenomenon is the way objective measurement is used. Namely, only a minor potential of the information available is typically used, and, for example, the temporal aspect (changes in time) is almost always neglected. The paper describes the TAM studies where objective measurement of usage has been utilized and ponders the way objective measurements are taken. The ultimate goal of the paper is to improve objective measures used in TAM studies. To this end, several suggestions are given.

[1]  Virpi Roto,et al.  User Experience of Mobile Internet: Analysis and Recommendations , 2009, Int. J. Mob. Hum. Comput. Interact..

[2]  Tore Dybå,et al.  Measuring software methodology usage: challenges of conceptualization and operationalization , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[3]  Andreas Möller,et al.  Investigating self-reporting behavior in long-term studies , 2013, CHI.

[4]  William R. King,et al.  Note-Participative Design of Strategic Decision Support Systems: An Empirical Assessment , 1981 .

[5]  Bernadette Szajna,et al.  Empirical evaluation of the revised technology acceptance model , 1996 .

[6]  Richard J. Holden,et al.  The Technology Acceptance Model: Its past and its future in health care , 2010, J. Biomed. Informatics.

[7]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[8]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[9]  Younghwa Lee,et al.  The Technology Acceptance Model: Past, Present, and Future , 2003, Commun. Assoc. Inf. Syst..

[10]  Antti Salovaara,et al.  Heterogeneous Use for Multiple Purposes: A Point of Concern to IS Use Models' Validity , 2013, ICIS.

[11]  Mark de Reuver,et al.  Dealing with self-report bias in mobile Internet acceptance and usage studies , 2015, Inf. Manag..

[12]  Mun Y. Yi,et al.  Predicting the use of web-based information systems: self-efficacy, enjoyment, learning goal orientation, and the technology acceptance model , 2003, Int. J. Hum. Comput. Stud..

[13]  Christian Maier,et al.  Objective measures of IS usage behavior under conditions of experience and pressure using eye fixation data , 2013, ICIS.

[14]  Ron Henderson,et al.  Perceived usefulness, ease of use and electronic supermarket use , 2003, Int. J. Hum. Comput. Stud..

[15]  Michael G. Morris,et al.  User Acceptance of Information Technology: Theories and Models , 1996 .

[16]  Ping Yu,et al.  Using diffusion of innovation theory to understand the factors impacting patient acceptance and use of consumer e-health innovations: a case study in a primary care clinic , 2015, BMC Health Services Research.

[17]  Fred D. Davis,et al.  Toward preprototype user acceptance testing of new information systems: implications for software project management , 2004, IEEE Transactions on Engineering Management.

[18]  Ben-Tzion Karsh,et al.  Review Paper: A Systematic Review of Patient Acceptance of Consumer Health Information Technology , 2009, J. Am. Medical Informatics Assoc..

[19]  BudgenDavid,et al.  Does the technology acceptance model predict actual use? A systematic literature review , 2010 .

[20]  Viswanath Venkatesh,et al.  Technology Acceptance Model 3 and a Research Agenda on Interventions , 2008, Decis. Sci..

[21]  Anthony R. Hendrickson,et al.  Desktop video conferencing in virtual workgroups: anticipation, system evaluation and performance , 2001, Inf. Syst. J..

[22]  Mohammad Chuttur,et al.  Overview of the Technology Acceptance Model: Origins, Developments and Future Directions , 2009 .

[23]  Richard G. Klein,et al.  Internet-Based Patient-Physician Electronic Communication Applications: Patient Acceptance and Trust , 2007 .

[24]  Fred L. Collopy,et al.  Biases in retrospective self-reports of time use: an empirical study of computer users , 1996 .

[25]  D. DavisFred,et al.  User Acceptance of Computer Technology , 1989 .

[26]  Leslie Stoel,et al.  Modeling the effect of experience on student acceptance of Web-based courseware , 2003, Internet Res..

[27]  Mike Kuniavsky,et al.  Observing the User Experience: A Practitioner's Guide to User Research (Morgan Kaufmann Series in Interactive Technologies) (The Morgan Kaufmann Series in Interactive Technologies) , 2003 .

[28]  Judy Kay,et al.  Studying long-term system use , 1995, CACM.

[29]  Dong-Hee Shin,et al.  Ubiquitous Computing Acceptance Model: end user concern about security, privacy and risk , 2010, Int. J. Mob. Commun..

[30]  Gordon R. Foxall,et al.  Technology acceptance: a meta‐analysis of the TAM: Part 1 , 2007 .

[31]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[32]  Jason H. Sharp.  Development, Extension, and Application: A Review of the Technology Acceptance Model , 2006 .

[33]  Pearl Brereton,et al.  Does the technology acceptance model predict actual use? A systematic literature review , 2010, Inf. Softw. Technol..

[34]  David Carrell,et al.  Variation in Adoption Rates of a Patient Web Portal with a Shared Medical Record by Age, Gender, and Morbidity Level , 2006, American Medical Informatics Association Annual Symposium.

[35]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[36]  Hongwei Du,et al.  Toward a better understanding of behavioral intention and system usage constructs , 2012, Eur. J. Inf. Syst..

[37]  Detmar W. Straub,et al.  Measuring System Usage: Implications for IS Theory Testing , 1995 .

[38]  D. Gustafson,et al.  An empirical study of perceived usefulness and perceived ease of use on computerized support system use over time , 1994 .

[39]  Andrina Granic,et al.  Technology acceptance model: a literature review from 1986 to 2013 , 2014, Universal Access in the Information Society.

[40]  Will W. K. Ma,et al.  E-Learning System Acceptance and Usage Pattern , 2011 .

[41]  Qingxiong Ma,et al.  The Technology Acceptance Model: A Meta-Analysis of Empirical Findings , 2004, J. Organ. End User Comput..

[42]  Chyan Yang,et al.  International Journal of Information Management the Intellectual Development of the Technology Acceptance Model: a Co-citation Analysis , 2022 .

[43]  Viswanath Venkatesh,et al.  Why Don't Men Ever Stop to Ask for Directions? Gender, Social Influence, and Their Role in Technology Acceptance and Usage Behavior , 2000, MIS Q..

[44]  Mike Kuniavsky,et al.  Observing the User Experience: A Practitioner's Guide to User Research (Second Edition) , 2013, IEEE Transactions on Professional Communication.

[45]  Subhasish Dasgupta,et al.  User Acceptance of E-Collaboration Technology: An Extension of the Technology Acceptance Model , 2002 .

[46]  Viswanath Venkatesh,et al.  Expectation Confirmation in Technology Use , 2012, Inf. Syst. Res..

[47]  J. Sachs,et al.  Test of the Technology Acceptance Model for a Web-Based Information System in a Hong Kong Chinese Sample , 2006, Psychological reports.

[48]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[49]  Jan Marco Leimeister,et al.  Towards Understanding the Formation of Continuous IT Use , 2013, ICIS.

[50]  Paul van Schaik,et al.  Modelling user experience - An agenda for research and practice , 2010, Interact. Comput..

[51]  Andrew Burton-Jones,et al.  New Perspectives on the System Usage Construct , 2005 .

[52]  Fred D. Davis.  A technology acceptance model for empirically testing new end-user information systems : theory and results , 1985 .

[53]  Peter A. Todd,et al.  Understanding Information Technology Usage: A Test of Competing Models , 1995, Inf. Syst. Res..

[54]  Frantz Rowe,et al.  What literature review is not: diversity, boundaries and recommendations , 2014, Eur. J. Inf. Syst..

[55]  Viswanath Venkatesh,et al.  User Acceptance Enablers in Individual Decision Making About Technology: Toward an Integrated Model , 2002, Decis. Sci..

[56]  Robert F. Easley,et al.  Research Note - How Does Personality Matter? Relating the Five-Factor Model to Technology Acceptance and Use , 2008, Inf. Syst. Res..

[57]  Henk de Poot,et al.  IM [@work]: adoption of instant messaging in a knowledge worker organisation , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[58]  William B. Lober,et al.  Barriers to the use of a Personal Health Record by an Elderly Population , 2006, AMIA.

[59]  Gary Garrison,et al.  Investigating mobile wireless technology adoption: An extension of the technology acceptance model , 2009, Inf. Syst. Frontiers.

[60]  Raquel Benbunan-Fich,et al.  Measuring multitasking behavior with activity-based metrics , 2011, TCHI.

[61]  Daniel Robey,et al.  User Attitudes and Management Information System Use , 1979 .

[62]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Independent Variables , 2013, J. Manag. Inf. Syst..

[63]  K. Lim,et al.  Investigating the Structural Relationship among Perceived Innovation Attributes, Intention to Use and Actual Use of Mobile Learning in an Online University in South Korea. , 2014 .

[64]  John Ingham,et al.  Why do people use information technology? A critical review of the technology acceptance model , 2003, Inf. Manag..

[65]  Dirk T. Tempelaar,et al.  Investigating the relations between motivation, tool use, participation, and performance in an e-learning course using web-videoconferencing , 2013, Comput. Hum. Behav..

[66]  C. Schewe.  The Management Information System User: An Exploratory Behavioral Analysis , 1976 .

[67]  Chris W. Clegg,et al.  Explaining intranet use with the technology acceptance model , 2001, J. Inf. Technol..

[68]  Ananth Srinivasan,et al.  Alternative Measures of Systems Effectiveness: Associations and Implications , 1985, MIS Q..

[69]  Isabelle Walsh,et al.  A strategic path to study IT use through users' IT culture and IT needs: A mixed-method grounded theory , 2014, J. Strateg. Inf. Syst..

[70]  Michael J. Ginzberg,et al.  Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions , 1981 .

[71]  Jin Zhang,et al.  Understanding the continued use of intra-organizational blogs: An adaptive habituation model , 2015, Comput. Hum. Behav..