Take Me Back: Validating the Wayback Machine

Although fields such as e-commerce, information systems, and computer-mediated communication CMC acknowledge the importance of validity, validating research tools or measures in these domains seems the exception rather than the rule. This article extends the concept of validation to one of an emerging genre of web-based tools that provide new measures, the Wayback Machine WM. Drawing in part on social science tests of validity, the study progresses from testing for and demonstrating the weakest form of validity, face validity, to the more demanding tests for content, predictive, and convergent validity. Finally, the study tests and shows nomological validity, using the diffusion of innovations theory. In line with prior diffusion research, the results of tests for predictive and nomological validity showed significant relationships with organizational characteristics and two WM measures: website age and number of updates. The results help validate these measures and demonstrate the utility of the WM for studying evolving website use.

[1]  Lei Wang,et al.  Three options for citation tracking: Google Scholar, Scopus and Web of Science , 2006, Biomedical digital libraries.

[2]  Patrali Chatterjee,et al.  Commercial Scenarios for the Web: Opportunities and Challenges , 1997, J. Comput. Mediat. Commun..

[3]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[4]  D. Fesenmaier,et al.  Identifying the Success Factors of Web-Based Marketing Strategy: An Investigation of Convention and Visitors Bureaus in the United States , 2006 .

[5]  C. Hall,et al.  The Impact of Tourism Knowledge: Google Scholar, citations and the opening up of academic space , 2006 .

[6]  Suzanne Beaumaster,et al.  Information Technology Implementation Issues: An Analysis , 1999 .

[7]  Hein Ruys,et al.  Uses of the Internet in the global hotel industry , 2001 .

[8]  Jamie Murphy,et al.  Islam and Online Imagery on Malaysian Tourist Destination Websites , 2007, J. Comput. Mediat. Commun..

[9]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[10]  Bambang Parmanto,et al.  A longitudinal evaluation of accessibility: higher education web sites , 2005, Internet Res..

[11]  Mike Thelwall,et al.  Scholarly Use of the Web: What Are the Key Inducers of Links to Journal Web Sites , 2003, J. Assoc. Inf. Sci. Technol..

[12]  Kurt Matzler,et al.  Determinants of response to customer e-mail enquiries to hotels: evidence from Austria , 2005 .

[13]  Richard T. Watson,et al.  Net-Based Customer Service Systems: Evolution and Revolution in Web Site Functionalities , 2004, Decis. Sci..

[14]  Edward Forrest,et al.  Hotel Management and Marketing on the Internet , 1996 .

[15]  Thompson S. H. Teo,et al.  A model for Web adoption , 2004, Inf. Manag..

[16]  Christos Makris,et al.  Improving the performance of Web access by bridging global ranking with local page popularity metrics , 2002, Internet Res..

[17]  Mike Thelwall,et al.  Three target document range metrics for university web sites , 2003, J. Assoc. Inf. Sci. Technol..

[18]  F. Damanpour.  Organizational Innovation: A Meta-Analysis Of Effects Of Determinants and Moderators , 1991 .

[19]  Judy A. Siguaw,et al.  Adoption of Information Technology in U.S. Hotels: Strategically Driven Objectives , 2000 .

[20]  Vallabh Sambamurthy,et al.  Shaping UP for E-Commerce: Institutional Enablers of the Organizational Assimliation of Web Technologies , 2002, MIS Q..

[21]  U. Sekaran,et al.  Research Methods for Business : A Skill Building Approach (5th Edition) , 1992 .

[22]  Earl R. Babbie,et al.  The practice of social research , 1969 .

[23]  Noor Hazarina Hashim,et al.  Branding on the Web: Evolving domain name usage among Malaysian hotels , 2007 .

[24]  Robert W. Zmud,et al.  Measuring technology incorporation/infusion , 1992 .

[25]  Eduardo Mosqueira-Rey,et al.  Validation of intelligent systems: a critical study and a tool , 2000 .

[26]  Mike Thelwall,et al.  Hyperlink Analyses of the World Wide Web: A Review , 2006, J. Comput. Mediat. Commun..

[27]  Jonathan W. Palmer,et al.  Web Site Usability, Design, and Performance Metrics , 2002, Inf. Syst. Res..

[28]  R. Schegg,et al.  Investigating the Evolution of Hotel Internet Adoption , 2006, J. Inf. Technol. Tour..

[29]  Sally J. McMillan.  Longevity of Websites and Interactive Advertising Communication , 2002 .

[30]  E. Rogers.  Diffusion of Innovations , 1962 .

[31]  Jamie Murphy,et al.  An investigation of global versus local online branding , 2007 .

[32]  Emin M. Dinlersoz,et al.  The Diffusion of Electronic Business in the United States , 2004 .

[33]  Lada A. Adamic,et al.  The Nature of Markets in the World Wide Web , 1999 .

[34]  Shari Lawrence Pfleeger,et al.  Towards a Framework for Software Measurement Validation , 1995, IEEE Trans. Software Eng..

[35]  Michael A. Veronin,et al.  Where Are They Now? A Case Study of Health-related Web Site Attrition , 2002, Journal of medical Internet research.

[36]  Detmar W. Straub,et al.  Validation Guidelines for IS Positivist Research , 2004, Commun. Assoc. Inf. Syst..

[37]  Thuong T. Le,et al.  A Managerial Perspective on Electronic Commerce Development in Malaysia , 2002, Electron. Commer. Res..

[38]  Lorne Olfman,et al.  The evolution of US state government home pages from 1997 to 2002 , 2003, Int. J. Hum. Comput. Stud..

[39]  Paul A. Pavlou,et al.  Understanding and Predicting Electronic Commerce Adoption: An Extension of the Theory of Planned Behavior , 2006, MIS Q..

[40]  Detmar W. Straub,et al.  Information Technology Adoption Across Time: A Cross-Sectional Comparison of Pre-Adoption and Post-Adoption Beliefs , 1999, MIS Q..

[41]  Michael Goul,et al.  Validating expert systems , 1990, IEEE Expert.

[42]  Andrew J. Frew.  Information Technology and Tourism: A Research Agenda , 2000, J. Inf. Technol. Tour..

[43]  Péter Jacsó,et al.  Comparison and Analysis of the Citedness Scores in Web of Science and Google Scholar , 2005, ICADL.

[44]  Saggi Nevo,et al.  Development and Validation of a Perceptual Instrument to Measure E-Commerce Performance , 2005, Int. J. Electron. Commer..

[45]  Joon Koh,et al.  Sense of Virtual Community : Conceptual Framework and Empirical Validation , 2001 .

[46]  Jamie Murphy,et al.  The bandwagon effect: Swiss hotels' web-site and e-mail management , 2003 .

[47]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[48]  Daniel Pauly,et al.  Equivalence of results from two citation analyses: Thomson ISI's Citation Index and Google's Scholar service , 2005 .

[49]  Louis E. Raho,et al.  Assimilating New Technology into the Organization: An Assessment of McFarlan and McKenney's Model , 1987, MIS Q..

[50]  SambamurthyV.,et al.  Shaping up for e-commerce , 2002 .

[51]  André Brock,et al.  "A Belief in Humanity is a Belief in Colored Men: " Using Culture to Span the Digital Divide , 2005, J. Comput. Mediat. Commun..

[52]  R. Bagozzi.  An Examination Of The Validity Of Two Models Of Attitude. , 1981, Multivariate behavioral research.

[53]  Waiman Cheung,et al.  Evolution of e-commerce Web sites: A conceptual framework and a longitudinal study , 2007, Inf. Manag..

[54]  M. Thelwall,et al.  Google Scholar citations and Google Web-URL citations: A multi-discipline exploratory analysis , 2007 .

[55]  R. Zmud,et al.  Information technology implementation research: a technological diffusion approach , 1990 .