External Validity in IS Survey Research

This study focuses on the issues of external validity, coverage error and nonresponse error in IS survey research. Data from the empirical papers in 5 years of issues from three “A rated” IS journals are presented and analyzed. Recommendations are made based on the analyses, basic scientific principles and the authors’ experience and judgment.

[1]  Michael J. Earl,et al.  Knowledge Management Strategies: Toward a Taxonomy , 2001, J. Manag. Inf. Syst..

[2]  Venkataraman Ramesh,et al.  Research in Information Systems: An Empirical Study of Diversity in the Discipline and Its Journals , 2002, J. Manag. Inf. Syst..

[3]  R. A. Ellis,et al.  The Use of Potential Nonrespondents for Studying Nonresponse Bias , 1970 .

[4]  R. Groves,et al.  Telephone Survey Methodology. , 1990 .

[5]  James R. Lindner,et al.  HANDLING NONRESPONSE IN SOCIAL SCIENCE RESEARCH , 2001 .

[6]  Beth A. Bechky.  Sharing Meaning Across Occupational Communities: The Transformation of Understanding on a Production Floor , 2003, Organ. Sci..

[7]  Carol P. Sosdian,et al.  Nonresponse in Mail Surveys: Access Failure or Respondent Resistance , 1980 .

[8]  L. Dooley,et al.  The handling of nonresponse error , 2003 .

[9]  Jerry Honeycutt,et al.  Knowledge Management Strategies , 2000 .

[10]  P. Chisnall.  Mail and Internet Surveys: The Tailored Design Method , 2007, Journal of Advertising Research.

[11]  Ilze Zigurs,et al.  A Study of Influence in Computer-Mediated Group Decision Making , 1988, MIS Q..

[12]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[13]  V. Sambamurthy,et al.  Information Technology Assimilation in Firms: The Influence of Senior Leadership and IT Infrastructures , 1999, Inf. Syst. Res..

[14]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[15]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[16]  Alain Pinsonneault,et al.  Survey Research Methodology in Management Information Systems: An Assessment , 1993, J. Manag. Inf. Syst..

[17]  Margaret Tan,et al.  Factors Influencing the Adoption of Internet Banking , 2000, J. Assoc. Inf. Syst..

[18]  Charmine Härtel.  The Industrial-Organizational Psychologist , 1993 .

[19]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[20]  Vijay Sethi,et al.  Construct Measurement in Information Systems Research: An Illustration in Strategic Systems , 1991 .

[21]  A. Richardson.  BEHAVIOURAL MECHANISMS OF NON-RESPONSE IN MAILBACK TRAVEL SURVEYS , 2000 .

[22]  William E. Knight,et al.  Profiling active and passive nonrespondents to an organizational survey. , 2003, The Journal of applied psychology.

[23]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[24]  Shirley A. Star,et al.  AMERICAN ASSOCIATION FOR PUBLIC OPINION RESEARCH , 1980 .

[25]  Tom W. Smith.  Reporting Survey Nonresponse in Academic Journals , 2002 .

[26]  R. Rosenthal,et al.  Artifact in behavioral research , 1969 .

[27]  Scott McCoy,et al.  The most important issues in knowledge management , 2002, CACM.

[28]  E. B. Swanson,et al.  Information systems innovation among organizations , 1994 .

[29]  V. Grover,et al.  An assessment of survey research in POM: from constructs to theory , 1998 .

[30]  James Y. L. Thong,et al.  An Integrated Model of Information Systems Adoption in Small Businesses , 1999, J. Manag. Inf. Syst..

[31]  H. Cooper,et al.  A Quantitative Review of Research Design Effects on Response Rates to Questionnaires , 1983 .

[32]  Prashant Palvia,et al.  Research Methodologies in MIS: An Update , 2004, Commun. Assoc. Inf. Syst..

[33]  Andrew B. Whinston,et al.  Understanding the Service Component of Application Service Provision: An Empirical Analysis of Satisfaction with ASP Services , 2003, MIS Q..

[34]  Gerardine DeSanctis,et al.  Computer-Based Support for Group Problem-Finding: An Experimental Investigation , 1988, MIS Q..

[35]  Jonathan W. Palmer,et al.  Web Site Usability, Design, and Performance Metrics , 2002, Inf. Syst. Res..

[36]  Michael Parent,et al.  Relationships Between Job Skills and Performance: A Study of Webmasters , 2002, J. Manag. Inf. Syst..

[37]  Martin J. Gannon,et al.  Characteristics of Nonrespondents Among Workers. , 1971 .

[38]  Gerardine DeSanctis,et al.  Using a GDSS to Facilitate Group Consensus: Some Intended and Unintended Consequences , 1988, MIS Q..

[39]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[40]  I. Ajzen.  The theory of planned behavior , 1991 .

[41]  Mani R. Subramani,et al.  The Matrix of Control: Combining Process and Structure Approaches to Managing Software Development , 2003, J. Manag. Inf. Syst..

[42]  William R. King,et al.  Measuring the Performance of Information Systems: A Functional Scorecard , 2005, J. Manag. Inf. Syst..

[43]  Alice M. Tybout,et al.  Designing Research for Application , 1981 .

[44]  Wanda J. Orlikowski,et al.  Knowing in practice: Enacting a collective capability in distributed organizing , 2002, STUDI ORGANIZZATIVI.

[45]  A. Adam.  Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[46]  E. Rogers.  Diffusion of Innovations , 1962 .