Validating an End-User Computing Satisfaction Instrument: A Confirmatory Factor Analysis Approach Using International Data

ABSTRACT This study evaluates the construct validity of an end-user computing satisfaction scale in the context of the Korean culture. The structure and dimensionality, reliability and validity of an end-user computing satisfaction (EUCS) instrument were cross-validated using data obtained from 108 managers of Korean firms in the context of the end-user satisfaction with their office information system. The results of this study are generally consistent with previous findings regarding the measurement property of this instrument. However, Korean data also supports the five correlated first-order factors model. Managerial and research implications of the identified results are discussed. INTRODUCTION Many studies have been conducted to explore the concept of user satisfaction with information systems and to examine the validity of measures of user satisfaction with information systems. User information system satisfaction (UISS) refers to the extent to which end-users perceive that an available information system meets their information requirements and needs. UISS has received significant attention in the literature because UISS is considered as a surrogate measure of information system success (Au, Ngai & Cheng, 2002; Galletta & Lederer, 1989). The reasons for user satisfaction being widely used as a measure of information system success include the availability of reliable measurement tools and their high face validity (DeLone & McLean, 1992). User information system satisfaction is often used as an indicator of user perception of the effectiveness and success of a management information system (Akbulut & Motwani, 2005; Bailey & Pearson, 1983; Doll & Torkzadeh, 1988). Although there have been several definitions and measures of end-user computing satisfaction (EUCS) (Bailey & Pearson, 1983; Doll & Torkzedah, 1988; Ives, Olson & Baroudi, 1983), Doll and Torkzadeh's end-user computing satisfaction (EUCS) instrument has been widely used as an end-user computing satisfaction measure that is relevant to specific software or information system applications. Their five-component model is based on a specific information system satisfaction of end-users. The five-component model consists of the accuracy, content, ease-of-use, format, and timeliness for the information system application. In addition, cross-cultural studies of end-user information system satisfaction have been conducted in many countries (McHaney, Hightower & Pearson, 2002; de Madariaga, 2004). In their comprehensive review of the relationship of culture with information and information technologies, Leidner and Kayworth (2006) reported that differences in culture could account for information technology use and outcome. They indicated that certain cultural values are related to user satisfaction and successful implementation of information systems. Similarly, Jones et al. (2003) reported cultural differences in the perception and use of EDI in a global setting. With increased globalization and the cross-cultural teamwork environment, information system implementation issues across countries are becoming more important. This new trend calls for extending research on end-user information system satisfaction and validating existing instruments in other countries (McHaney, Hightower & Pearson, 2002). This study recognizes the importance of the cross-cultural validation research requirement and continues this research stream. Thus, a further cross-cultural extension of the existing end-user computing satisfaction instrument is warranted. The purpose of the current study, therefore, is to examine the construct validity of Doll and Torkzadeh's end-user computing satisfaction instrument in South Korea. The validation of the instrument is performed by assessing the end-user satisfaction of office information system by managers in various South Korean firms. CONCEPTUAL BACKGROUND In the past, many researchers have utilized the measurement of end-user satisfaction as a surrogate measure of the success of a specific application (Bailey & Pearson, 1983; DeLone & McLean, 1992; Ives & Olson, 1984). …

[1]  Maris G. Martinsons,et al.  Management information systems in the Chinese business culture: An explanatory theory , 1997, Inf. Manag..

[2]  Barry Shore,et al.  Role of national culture in the transfer of information technology , 1996, J. Strateg. Inf. Syst..

[3]  R. Bagozzi,et al.  On the evaluation of structural equation models , 1988 .

[4]  G MartinsonsMaris,et al.  Management information systems in the Chinese business culture , 1997 .

[5]  Charles E. Downing,et al.  System usage behavior as a proxy for user satisfaction: an empirical investigation , 1999, Inf. Manag..

[6]  Detmar W. Straub,et al.  Gender Differences in the Perception and Use of E-Mail: An Extension to the Technology Acceptance Model , 1997, MIS Q..

[7]  Karin Klenke,et al.  Construct Measurement in Management Information systems: A Review and Critique of User Satisfaction , 1992 .

[8]  Peter A. Todd,et al.  Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication , 1992, MIS Q..

[9]  Robert W. Zmud,et al.  Behavioral Intention Formation in Knowledge Sharing: Examining the Roles of Extrinsic Motivators, Social-Psychological Factors, and Organizational Climate , 2005, MIS Q..

[10]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[11]  William H. DeLone,et al.  Global boundaries, task processes and IS project success: a field study , 2006, Inf. Technol. People.

[12]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[13]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[14]  Roger McHaney,et al.  EUCS test-retest reliability in representational model decision support systems , 1999, Inf. Manag..

[15]  C. McDermott,et al.  Organizational culture and advanced manufacturing technology implementation , 1999 .

[16]  E. Spires,et al.  Cross-Cultural Differences in Choice Behavior and Use of Decision Aids: A Comparison of Japan and the United States. , 1999, Organizational behavior and human decision processes.

[17]  Weidong Xia,et al.  Confirmatory Factor Analysis of the End-User Computing Satisfaction Instrument: A Replication , 1997 .

[18]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[19]  Timothy Paul Cronan,et al.  On the Test-Retest Reliability of Perceived Usefulness and Perceived Ease of Use Scales , 1993 .

[20]  Harry Scarbrough,et al.  Cultural influences on IT use amongst factory managers: a UK–Japanese comparison , 2001, J. Inf. Technol..

[21]  Leyland F. Pitt,et al.  Potential Research Space in MIS: A Framework for Envisioning and Evaluating Research Replication, Extension, and Generation , 2002, Inf. Syst. Res..

[22]  R. Brislin.  Understanding culture's influence on behavior , 1993 .

[23]  Asli Yagmur Akbulut,et al.  The Road to ERP Success: Understanding End-User Perceptions , 2005 .

[24]  Inju Yang.  Jeong exchange and collective leadership in Korean organizations , 2006 .

[25]  S. Kanungo.  An empirical study of organizational culture and network-based computer use , 1998 .

[26]  Dennis F. Galletta,et al.  Some Cautions on the Measurement of User Information Satisfaction , 1989 .

[27]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[28]  Dorothy E. Leidner,et al.  Review: A Review of Culture in Information Systems Research: Toward a Theory of Information Technology Culture Conflict , 2006, MIS Q..

[29]  Ravi Nath,et al.  A Study of the Relationship Between Internet Diffusion and Culture , 2004, Journal of International Technology and Information Management.

[30]  Timothy Paul Cronan,et al.  Computer Simulation Success: On the Use of the End-User Computing Satisfaction Instrument: A Comment , 1998 .

[31]  G. Hofstede.  The Cultural Relativity of Organizational Practices and Theories , 1983 .

[32]  Chun Wei Choo,et al.  The Strategic Management of Intellectual Capital and Organizational Knowledge , 2002 .

[33]  June Wei,et al.  Development of a Risk Assessment Model for Global Information Technology Outsourcing , 2006, Journal of International Technology and Information Management.

[34]  Eric W.T. Ngai,et al.  A critical review of end-user information system satisfaction research and a new research framework , 2002 .

[35]  Detmar W. Straub,et al.  The Effect of Culture on IT Diffusion: E-Mail and FAX in Japan and the U.S , 1994, Inf. Syst. Res..

[36]  K. Möller,et al.  Crossing East-West boundaries: Knowledge sharing in intercultural business networks , 2004 .

[37]  Lei-da Chen,et al.  Measuring user satisfaction with data warehouses: an exploratory study , 2000, Inf. Manag..

[38]  E. Carmines,et al.  Analyzing models with unobserved variables: analysis of covariance structures , 1981 .

[39]  S. J. Simon.  The Relationship of Learning Style and Training Method to End-User Computer Satisfaction and Computer Use: A Structural Equation Model. , 2000 .

[40]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[41]  Timothy Paul Cronan,et al.  On the Repeated Test-Retest Reliability of the End-User Computing Satisfaction Instrument: A Comment* , 1994 .

[42]  Jay F. Nunamaker,et al.  A Collaborative Project Management Approach and a Framework for its Supporting Systems , 2006 .

[43]  D. Utley,et al.  Organizational Culture and Successful Information Technology Implementation , 2001 .

[44]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[45]  Roger McHaney,et al.  A validation of the end-user computing satisfaction instrument in Taiwan , 2002, Inf. Manag..

[46]  William R. King,et al.  Organizational Characteristics and Information Systems Planning: An Empirical Study , 1994, Inf. Syst. Res..

[47]  Dane K. Peterson,et al.  Perceptions of Information Systems Objectives: A Comparison of IS Professionals from the United States and Korea , 2003 .

[48]  William J. Doll,et al.  A Confirmatory Factor Analysis of the End-User Computing Satisfaction Instrument , 1994, MIS Q..

[49]  J. Daniel Couger,et al.  ICIS Paper: Effect of Cultural Differences on Motivation of Analysts and Programmers: Singapore vs. the United States , 1986, MIS Q..

[50]  Eleanor T. Loiacono,et al.  A Cross-Cultural Comparison of U.S. and Chinese Website Customers , 2005, Journal of International Technology and Information Management.

[51]  Detmar W. Straub,et al.  Culture and consumer responses to web download time: a four-continent study of mono and polychronism , 2003, IEEE Trans. Engineering Management.

[52]  James T. C. Teng,et al.  Impact of national culture on information technology usage behaviour: An exploratory study of decision making in Korea and the USA , 2002, Behav. Inf. Technol..

[53]  Dane K. Peterson,et al.  A Comparison of the Perceived Importance of Information Systems Development Strategies by Developers from the United States and Korea , 2003, Inf. Resour. Manag. J..

[54]  GefenDavid,et al.  Validation in information systems research , 2001 .

[55]  Richard T. Watson,et al.  Culture: a fourth dimension of group support systems , 1994, CACM.

[56]  Toni M. Somers,et al.  Confirmatory Factor Analysis of the End-User Computing Satisfaction Instrument: Replication within an ERP Domain , 2003, Decis. Sci..