Reconceptualizing System Usage: An Approach and Empirical Test

Although DeLone, McLean, and others insist that system usage is a key variable in information systems research, the system usage construct has received little theoretical scrutiny, boasts no widely accepted definition, and has been operationalized by a diverse set of unsystematized measures. In this article, we present a systematic approach for reconceptualizing the system usage construct in particular nomological contexts. Comprising two stages, definition and selection, the approach enables researchers to develop clear and valid measures of system usage for a given theoretical and substantive context. The definition stage requires that researchers define system usage and explicate its underlying assumptions. In the selection stage, we suggest that system usage be conceptualized in terms of its structure and function. The structure of system usage is tripartite, comprising a user, system, and task, and researchers need to justify which elements of usage are most relevant for their study. In terms of function, researchers should choose measures for each element (i.e., user, system, and/or task) that tie closely to the other constructs in the researcher's nomological network. To provide evidence of the viability of the approach, we undertook an empirical investigation of the relationship between system usage and short-run task performance in cognitively engaging tasks. The results support the benefits of the approach and show how an inappropriate choice of usage measures can lead researchers to draw opposite conclusions in an empirical study. Together, the approach and the results of the empirical investigation suggest new directions for research into the nature of system usage, its antecedents, and its consequences.

[1]  Dale Goodhue,et al.  Task-Technology Fit and Individual Performance , 1995, MIS Q..

[2]  William D. Nance,et al.  Task/technology fit and knowledge worker use of information technology : a study of auditors , 1992 .

[3]  William J. Doll,et al.  Developing a multidimensional measure of system-use in an organizational context , 1998, Inf. Manag..

[4]  Pamela E. Carter,et al.  A Comprehensive Conceputalization of the Post-Adoptive Behaviors Associated with IT-Enabled Work Systems , 2005 .

[5]  Toni M. Somers,et al.  Impact of Environmental Uncertainty and Task Characteristics on User Satisfaction with Data , 2004, Inf. Syst. Res..

[6]  Henri Barki,et al.  Explaining the Role of User Participation in Information System Use , 1994 .

[7]  M. Frese,et al.  Performance Concepts and Performance Theory , 2005 .

[8]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[9]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[10]  Kevin Crowston,et al.  Tools for Inventing Organizations: Toward a Handbook of Organizational Processes , 1999 .

[11]  Kevin Crowston,et al.  Tools for inventing organizations: toward a handbook of organizational processes , 1993, [1993] Proceedings Second Workshop on Enabling Technologies@m_Infrastructure for Collaborative Enterprises.

[12]  Andrew Burton-Jones,et al.  New Perspectives on the System Usage Construct , 2005 .

[13]  R. Proctor,et al.  Skill acquisition and human performance , 1995 .

[14]  M. Eysenck Attention And Arousal, Cognition And Performance , 1982 .

[15]  Jan-Bernd Lohmöller,et al.  Latent Variable Path Modeling with Partial Least Squares , 1989 .

[16]  Alice M. Tybout,et al.  Designing Research for Application , 1981 .

[17]  J. March The Pursuit of Organizational Intelligence , 1999 .

[18]  J. Hair Multivariate data analysis , 1972 .

[19]  Willard O. Eddy Review of The predictable failure of educational reform , 1994 .

[20]  Albert H. Segars,et al.  Strategic Information Systems Planning Success: An Investigation of the Construct and Its Measurement , 1998, MIS Q..

[21]  T Auer,et al.  Quality of IS use , 1998 .

[22]  M. Treacy,et al.  Utilization as a dependent variable in MIS research , 2015, DATB.

[23]  A. Adam Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[24]  Robert W. Zmud,et al.  A Comprehensive Conceptualization of Post-Adoptive Behaviors Associated with Information Technology Enabled Work Systems , 2005, MIS Q..

[25]  E. B. Swanson,et al.  Measuring Business Value of Information Technologies , 1988 .

[26]  Vikki Lynn Saga,et al.  The nature and determinants of information technology infusion: An organizational level of analysis , 1994 .

[27]  J. Miller,et al.  Development of an Instrument To Measure Hope , 1988, Nursing research.

[28]  Maurice Landry,et al.  A disciplined methodological pluralism for mis research , 1992 .

[29]  Detmar W. Straub,et al.  Measuring System Usage: Implications for IS Theory Testing , 1995 .

[30]  Cheryl Burke Jarvis,et al.  A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research , 2003 .

[31]  Rajiv Kohli,et al.  Performance Impacts of Information Technology: Is Actual Usage the Missing Link? , 2003, Manag. Sci..

[32]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[33]  Fred D. Davis,et al.  Extension of the Technology Acceptance Model: Four Longitudinal Field : . , 2000 .

[34]  Henry C. Lucas,et al.  Empirical Evidence for a Descriptive Model of Implementation , 1978, MIS Q..

[35]  Joseph J. Martocchio,et al.  Microcomputer playfulness: development of a measure with workplace implications , 1992 .

[36]  Malcolm Munro,et al.  Assessing User Competence: Conceptualization and Measurement , 2000, Inf. Syst. Res..

[37]  Wynne W. Chin,et al.  The future of diffusion research , 2001, DATB.

[38]  Ilze Zigurs,et al.  A Theory of Task/Technology Fit and Group Support Systems Effectiveness , 1998, MIS Q..

[39]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[40]  BenbasatIzak,et al.  Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation , 1991 .

[41]  Kenneth S. Law,et al.  Toward A Taxonomy of Multidimensional Constructs , 1998 .

[42]  Izak Benbasat,et al.  Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation , 1991, Inf. Syst. Res..

[43]  W ChinWynne,et al.  Advancing the Theory of Adaptive Structuration , 1997 .

[44]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[45]  Peter A. Todd,et al.  Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication , 1992, MIS Q..

[46]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[47]  David Meister Human Factors Testing and Evaluation , 1986 .

[48]  Ron Weber,et al.  Ontological foundations of information systems , 1997 .

[49]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[50]  Dorothy E. Denning,et al.  Ultra-structure: a design theory for complex systems and processes , 1995, CACM.

[51]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[52]  Dale Goodhue,et al.  Understanding user evaluations of information systems , 1995 .

[53]  Brian T. Pentland,et al.  Use and productivity in personal computing , 1989, ICIS '89.

[54]  Loizos Heracleous,et al.  Organizational Change as Discourse: Communicative Actions and Deep Structures in the Context of Information Technology Implementation , 2001 .

[55]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[56]  David F. Redmiles,et al.  Extracting usability information from user interface events , 2000, CSUR.

[57]  Magid Igbaria,et al.  Personal Computing Acceptance Factors in Small Firms: A Structural Equation Model , 1997, MIS Q..

[58]  J. March Exploration and exploitation in organizational learning , 1991, STUDI ORGANIZZATIVI.

[59]  Charalampos Mainemelis,et al.  When The Muse Takes It All: A Model For The Experience of Timelessness in Organizations , 2001 .

[60]  Mani Subramani,et al.  How Do Suppliers Benefit from Information Technology Use in Supply Chain Relationships? , 2004, MIS Q..

[61]  D. Beal,et al.  Cohesion and performance in groups: a meta-analytic clarification of construct relations. , 2003, The Journal of applied psychology.

[62]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[63]  Wynne W. Chin,et al.  Advancing the Theory of Adaptive Structuration: The Development of a Scale to Measure Faithfulness of Appropriation , 1997, Inf. Syst. Res..

[64]  R. Motl,et al.  Longitudinal Invariance of Self-Esteem and Method Effects Associated With Negatively Worded Items , 2002 .

[65]  E. A. Locke,et al.  A theory of goal setting & task performance , 1990 .

[66]  J. Edwards Multidimensional Constructs in Organizational Behavior Research: An Integrative Analytical Framework , 2001 .

[67]  D. Ilgen,et al.  The Changing Nature of Performance: Implications for Staffing, Motivation, and Development. Frontiers of Industrial and Organizational Psychology. , 1999 .

[68]  Margaret Tan,et al.  The consequences of information technology acceptance on subsequent individual performance , 1997, Inf. Manag..

[69]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[70]  Wynne W. Chin,et al.  Research Report - The Importance of Specification in Causal Modeling: The Case of End-User Computing Satisfaction , 1995, Inf. Syst. Res..

[71]  Gerardine DeSanctis,et al.  Capturing the Complexity in Advanced Technology Use: Adaptive Structuration Theory , 1994 .

[72]  Raymond R. Panko,et al.  What we know about spreadsheet errors , 1998 .

[73]  Henry C. Lucas,et al.  Technology Use and Performance: A Field Study of Broker Workstations* , 1999 .

[74]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[75]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[76]  Peter B. Seddon A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[77]  Bernadette Szajna,et al.  Determining information system usage: Some issues and examples , 1993, Inf. Manag..

[78]  M. Csíkszentmihályi Flow: The Psychology of Optimal Experience , 1990 .

[79]  Daniel Robey,et al.  Research Commentary: Diversity in Information Systems Research: Threat, Promise, and Responsibility , 1996, Inf. Syst. Res..

[80]  John C. Henderson,et al.  An Evolutionary Strategy for Implementing a Decision Support System , 1981 .

[81]  Rob Kling,et al.  Reconceptualizing Users as Social Actors in Information Systems Research , 2003, MIS Q..

[82]  D. Campbell,et al.  Convergent and Discriminant Validity by the Multitrait-Multimethod Matrix,” Psychological Bulletin (2), March, pp. . , 1959 .

[83]  Ananth Srinivasan,et al.  Alternative Measures of Systems Effectiveness: Associations and Implications , 1985, MIS Q..

[84]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[85]  Sabine Sonnentag,et al.  Psychological Management of Individual Performance: Sonnentag/Psychological Management , 2005 .

[86]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[87]  Kristi Yuthas,et al.  Material matters: Assessing the effectiveness of materials management IS , 1998, Inf. Manag..

[88]  Gary W. Dickson,et al.  An investigation of information system utilization , 1977, Inf. Manag..

[89]  Michael J. Ginzberg,et al.  Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions , 1981 .

[90]  John Benjafield,et al.  Cognition, 3rd ed. , 2007 .

[91]  N. Melone A theoretical assessment of the user-satisfaction construct in information systems research , 1990 .

[92]  Terri L. Griffith,et al.  Distinguishing Between the Forest and the Trees: Media, Features, and Methodology in Electronic Communication Research , 1994 .

[93]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Independent Variables , 1992, J. Manag. Inf. Syst..

[94]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[95]  C. Gersick REVOLUTIONARY CHANGE THEORIES: A MULTILEVEL EXPLORATION OF THE PUNCTUATED EQUILIBRIUM PARADIGM , 1991 .

[96]  Sven A. Carlsson,et al.  A longitudinal study of spreadsheet program use , 1988, [1988] Proceedings of the Twenty-First Annual Hawaii International Conference on System Sciences. Volume III: Decision Support and Knowledge Based Systems Track.

[97]  Andrew Neal,et al.  Technology and performance , 1999 .

[98]  James C. Brancheau,et al.  Adoption and Utilization of Commercial Software Packages: Exploring Utilization Equilibria, Transitions, Triggers, and Tracks , 1999, J. Manag. Inf. Syst..

[99]  John P. Campbell,et al.  Modeling the performance prediction problem in industrial and organizational psychology. , 1990 .

[100]  Brian T. Pentland,et al.  USE AND PRODUCTIVITY IN PERSONAL COMPUTING: AN EMPIRICAL TEST , 1989 .

[101]  Wynne W. Chin,et al.  Extending the technology acceptance model: the influence of perceived user resources , 2001, DATB.

[102]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[103]  Deborah Compeau,et al.  Social Cognitive Theory and Individual Reactions to Computing Technology: A Longitudinal Study , 1999, MIS Q..

[104]  Terri L. Griffith Technology Features as Triggers for Sensemaking , 1999 .