Businesses as Buildings: Metrics for the Architectural Quality of Internet Businesses

Metrics for the architectural quality of Internet businesses are essential in gauging the success and failure of e-commerce. This study proposes six dimensions of architectural metrics for Internet businesses:internal stability, external security, information gathering, order processing, system interface, andcommunication interface. The metrics are based on the three constructs that have been used to evaluate buildings in the real world. The structural construct indicates that Internet businesses need to be stable internally and secure externally. The functional construct implies that Internet businesses should provide convenient functions in the information-gathering and order-processing phases. Finally, the representational construct indicates that they need to provide a pleasant interface both to the systemand to those using it. For each of the six metrics, we have constructed questionnaires to measure the perceived level of architectural quality and identified feature lists that may be closely related to the perceived quality level. Large-scale empirical studies were conducted both to validate the proposed metrics and to explore their relevance across four Internet business domains. The validity of the metrics has been obtained in three ways. First, the content validity of the metrics was assured by pretests and pilot survey. Second, the results fromthe confirmatory factor analysis showed that the metrics had high convergent and discriminant validities. Finally, the reliability coefficients were found to be high enough to establish the reliability of the proposed metrics. The relevance of the metrics has been explored in two ways. Structural equation models were used to test the causal relations between the three constructs and user satisfaction, as well as customer loyalty, in four domains. Correlation analyses were used to explore the relations between the perceived architectural quality and objective design features in four domains. This paper ends with the implications and limitations of the study results.

[1]  Il Im,et al.  Reengineering IS Research and Its Intellectual Infrastructure for the Electronic Economy , 2000, J. Organ. Comput. Electron. Commer..

[2]  Mitchell Kapor A software design manifesto , 1990 .

[3]  Louis B. Rosenfeld,et al.  Information architecture for the world wide web - designing large-scale web sites , 1998 .

[4]  H. Klein,et al.  Information systems research: contemporary approaches and emergent traditions , 1991 .

[5]  Michael Tow Cheung,et al.  Internet-based e-banking and consumer attitudes: an empirical study , 2002, Inf. Manag..

[6]  Andrew Howes,et al.  A framework for understanding human factors in web-based electronic commerce , 2000, Int. J. Hum. Comput. Stud..

[7]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[8]  Gerald L. Lohse,et al.  Electronic shopping , 1998, CACM.

[9]  Peter B. Seddon A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[10]  Richard L. Daft,et al.  Organizational information requirements, media richness and structural design , 1986 .

[11]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[12]  J. Hagel,et al.  The Real Value of Online Communities , 2000 .

[13]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[14]  Anish Bhimani,et al.  Securing the commercial Internet , 1996, CACM.

[15]  Tony Davies,et al.  Going with the flow: Web sites and customer involvement , 1999, Internet Res..

[16]  Dennis F. Galletta,et al.  Extending the technology acceptance model to account for social influence: theoretical bases and empirical validation , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[17]  R. Wigand,et al.  Electronic Markets and Virtual Value Chains on the Information Superhighway , 1995 .

[18]  Kar Yan Tam,et al.  Impact of information presentation modes on online shopping: An empirical evaluation of a broadband interactive shopping service , 2000 .

[19]  Patiwat Panurach,et al.  Money in electronic commerce: digital cash, electronic fund transfer, and Ecash , 1996, CACM.

[20]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[21]  Marti A. Hearst,et al.  Empirically validated web page design metrics , 2001, CHI.

[22]  LiaoZiqi,et al.  Internet-based e-shopping and consumer attitudes an empirical study , 2001 .

[23]  Siegfried Giedion,et al.  Space, time and architecture : the growth of a new tradition , 1941 .

[24]  Wen-Hsiung Wu,et al.  Antecedents of Customer Satisfaction on the Internet: An Empirical Study of Online Shopping , 1999 .

[25]  Eelko K. R. E. Huizingh,et al.  The content and design of web sites: an empirical study , 2000, Inf. Manag..

[26]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[27]  C. Zimring,et al.  Post-Occupancy Evaluation , 1980 .

[28]  Jinwoo Kim,et al.  Designing towards emotional usability in customer interfaces trustworthiness of cyber-banking system interfaces , 1998, Interact. Comput..

[29]  María Soledad Rodríguez González,et al.  Empirical validation of a model of user satisfaction with buildings and their environments as workplaces , 1997 .

[30]  L. Berry Relationship marketing of services—growing interest, emerging perspectives , 1995 .

[31]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[32]  Arno Scharl,et al.  Quantitive evaluation of Web site content and structure , 2000, Internet Res..

[33]  Mitsuru Kodama,et al.  Strategic business applications and new virtual knowledge-based businesses through community-based information networks , 1999, Inf. Manag. Comput. Secur..

[34]  Izak Benbasat,et al.  Empirical Research in Information Systems: The Practice of Relevance , 1999, MIS Q..

[35]  Chang Liu,et al.  Web sites of the Fortune 500 companies: Facing customers through home pages , 1997, Inf. Manag..

[36]  Thomas P. Moran,et al.  The Command Language Grammar: A Representation for the User Interface of Interactive Computer Systems , 1981, Int. J. Man Mach. Stud..

[37]  Gary Perlman Practical usability evaluation , 1994, CHI '94.

[38]  Dennis L. Hoffman,et al.  Marketing in Hypermedia Computer-Mediated Environments : Conceptual Foundations 1 ) , 1998 .

[39]  Robert M. O'Keefe,et al.  Web-based customer decision support systems , 1998, CACM.

[40]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[41]  I. Ajzen The theory of planned behavior , 1991 .

[42]  Gavriel Salvendy,et al.  A proposed index of usability: A method for comparing the relative usability of different software systems , 1997, Behav. Inf. Technol..

[43]  Jinwoo Kim,et al.  Contextual Navigation Aids for Two World Wide Web Systems , 2000, Int. J. Hum. Comput. Interact..

[44]  Chang Liu,et al.  Exploring the factors associated with Web site success in the context of electronic commerce , 2000, Inf. Manag..

[45]  B. Schmid,et al.  Electronic Mall: Banking und Shopping in globalen Netzen , 1995 .

[46]  Monica Perry,et al.  Content analysis of Fortune 100 company Web sites , 2000 .

[47]  D. Campbell Recommendations for APA test standards regarding construct, trait, or discriminant validity. , 1960 .

[48]  William J. Mitchell,et al.  City of bits: space, place, and the infobahn , 1995 .

[49]  Jeremiah Sullivan,et al.  What are the functions of corporate home pages , 1999 .

[50]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[51]  Terry Winograd,et al.  Bringing Design to Software , 1996 .

[52]  Cynthia Calongne,et al.  Designing for web site usability , 2001 .

[53]  Jacob Slonim,et al.  Globalizing business, education, culture through the Internet , 1997, CACM.

[54]  Thomas H. Davenport,et al.  Rigor vs. relevance revisited: response to Benbasat and Zmud , 1999 .

[55]  Richard Y. Wang,et al.  Quality information and knowledge , 1998 .

[56]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[57]  Petra Schubert,et al.  Web Assessment - A Model for the Evaluation and the Assessment of successful Electronic Commerce Applications , 1997, Electron. Mark..

[58]  Jinwoo Kim,et al.  Toward the optimal link structure of the cyber shopping mall , 2000, Int. J. Hum. Comput. Stud..

[59]  Ting-Peng Liang,et al.  An empirical study on consumer acceptance of products in electronic markets: a transaction cost model , 1998, Decis. Support Syst..

[60]  Andrew B. Whinston,et al.  The Internet and the future of financial markets , 2000, CACM.