27 Behavioral Research and Data Collection via the Internet

In the past 15 years it has become possible to collect data from participants who are tested via the Internet rather than in the laboratory. Although this mode of research has some inherent limitations owing to lack of control and observation of conditions, it also has a number of advantages over lab research. Many of the potential advantages have been well-described in a number of publications (Birnbaum 2000a, 2001a, 2004a, 2007; Krantz and Dalal 2000; Reips 1995, 2000, 2006, 2007; Reips and Bosnjak 2001; Schmidt 1997a, 1997b). Some of the chief advantages are that (1) one can test large numbers of participants very quickly, (2) one can recruit large heterogeneous samples and people with rare characteristics, and (3) the method is more cost-effective in time, space, and labor in comparison with lab research. This chapter provides an introduction to the major features of the new approach and illustrates the most important techniques in this area of research. 27 Behavioral Research and Data Collection via the Internet

[1]  Curtis D. Hardin,et al.  Malleability of "ratio" judgments of occupational prestige. , 1990 .

[2]  Ulf-Dietrich Reips,et al.  Das psychologische Experimentieren im Internet , 1997 .

[3]  Stefan Stieger,et al.  Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[4]  W. Schmidt,et al.  World-Wide Web survey research made easy with WWW Survey Assistant , 1997 .

[5]  Ulf-Dietrich Reips,et al.  Merging Field and Institution : Running a Web Laboratory , 2001 .

[6]  Jesse James Garrett.  Ajax: A New Approach to Web Applications , 2007 .

[7]  M. Birnbaum.  Human research and data collection via the internet. , 2004, Annual review of psychology.

[8]  Stefan Schwarz,et al.  CGI versus JavaScript : a Web Experiment on the Reversed Hindsight Bias , 2001 .

[9]  M. Birnbaum.  A Web-Based Program of Research on Decision Making , 2001 .

[10]  Tom Buchanan,et al.  Potential of the Internet for personality research , 2000 .

[11]  Ulf-Dietrick Reips,et al.  Internet-Based Psychological Experimenting , 2002 .

[12]  Ulf-Dietrich Reips,et al.  WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[13]  Michael H. Birnbaum,et al.  Mediated Models for the Analysis of Confounded Variables and Self-Selected Samples , 1989 .

[14]  Ulf-Dietrich Reips,et al.  Web-Based Methods , 2006 .

[15]  Anja S Göritz,et al.  Generic HTML Form Processor: A versatile PHP script to save Web-collected data into a MySQL database , 2005, Behavior research methods.

[16]  Ulf-Dietrich Reips,et al.  Online research with children , 1999 .

[17]  Mark D. Tew,et al.  Undergraduate labs and computers: The case for PsychExps , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[18]  Aimée M. Surprenant,et al.  The Cognitive Psychology Online Laboratory , 2000 .

[19]  Reeshad S. Dalal,et al.  Validity of Web-Based Psychological Research , 2000 .

[20]  Michael H. Birnbaum,et al.  Judgments of differences and ratios of numerals , 1975 .

[21]  Jolene D. Smyth,et al.  Effects of Using Visual Design Principles to Group Response Options in Web Surveys , 2006 .

[22]  M. Birnbaum.  Testing Critical Properties of Decision Making on the Internet , 1999 .

[23]  Tracy L. Tuten,et al.  Internet Surveys and Data Quality : A Review , 2002 .

[24]  Attila Szabo,et al.  Guidelines for Internet Research , 1998 .

[25]  R. Chris Fraley.  How to conduct behavioral research over the Internet , 1992 .

[26]  Ulf-Dietrich Reips,et al.  Mitarbeiterbefragungen per Internet oder Papier? : Der Einfluss von Anonymität, Freiwilligkeit und Alter auf das Antwortverhalten , 2004 .

[27]  Ulf-Dietrich Reips,et al.  Financial Incentives, Personal Information and Drop Out in Online Studies , 2001 .

[28]  U D Reips.  The Web Experimental Psychology Lab: Five years of data collection on the Internet , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[29]  M H Birnbaum,et al.  SurveyWiz and factorWiz: Javascript Web pages that make HTML forms for research on the internet , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[30]  Michael A. Smith,et al.  Virtual subjects: Using the Internet as an alternative source of subjects and research environment , 1997 .

[31]  Allen Parducci,et al.  Happiness, Pleasure, and Judgment: The Contextual Theory and Its Applications , 1995 .

[32]  Ulf-Dietrich Reips.  Standards for Internet-based experimenting. , 2002, Experimental psychology.

[33]  Ulf-Dietrich Reips,et al.  A Brief History of Web Experimenting , 2000 .

[34]  Terri Gullickson,et al.  Publication Manual of the American Psychological Association (4th ed.). , 1996 .

[35]  Ulf-Dietrich Reips,et al.  TheWeb Experiment List: A web service for the recruitment of participants and archiving of Internet-based experiments , 2005, Behavior research methods.

[36]  Jonathan Baron,et al.  Techniques for Creating and Using Web Questionnaires in Research and Teaching , 2000 .

[37]  Tom Buchanan,et al.  Online personality assessment , 2001 .

[38]  William C. Schmidt,et al.  World-Wide Web survey research: Benefits, potential problems, and solutions , 1997 .

[39]  John H. Krantz,et al.  Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness , 1997 .

[40]  Norma Welch,et al.  The World-Wide Web as a medium for psychoacoustical demonstrations and experiments: Experience and results , 1996 .

[41]  Michael H. Birnbaum,et al.  How to show that 9 > 221 : Collect judgments in a between-subjects design , 1999 .

[42]  Robert M. Davison,et al.  Web-Based Data Collection in China , 2006, J. Glob. Inf. Manag..

[43]  Wolfgang Bandilla,et al.  Banner-advertised web surveys , 2000 .

[44]  Ulf-Dietrich Reips,et al.  Dimensions of Internet science , 2001 .

[45]  M. K. Stevenson,et al.  Decision making with long-term consequences: temporal discounting for single and multiple outcomes in the future , 1993 .

[46]  William C. Schmidt,et al.  The Server Side of Psychology Web Experiments , 2000 .

[47]  Ulf-Dietrich Reips,et al.  Sleep, sex, and the Web: Surveying the difficult-to-reach clinical population suffering from sexsomnia , 2007, Behavior research methods.

[48]  Ulf-Dietrich Reips,et al.  Theory and Techniques of Conducting Web Experiments , 2002 .

[49]  Ulf-Dietrich Reips,et al.  The Web Experiment Method , 2000 .

[50]  Ulf-Dietrich Reips,et al.  Context Effects in Web Surveys , 2002 .

[51]  Michael H. Birnbaum,et al.  Introduction to Behavioral Research on the Internet , 2000 .

[52]  Arndt Bröder,et al.  Improving survey research on the World-Wide Web using the randomized response technique , 2001 .

[53]  M. Birnbaum.  Methodological and Ethical Issues in Conducting Social Psychology Research via the Internet. , 2004 .

[54]  Ron Hoffman,et al.  Operate your own World-Wide Web server , 1997 .

[55]  J Eichstaedt,et al.  An inaccurate-timing filter for reaction time measurement by JAVA applets implementing Internet-based experiments , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[56]  John H. Krantz,et al.  Stimulus Delivery on the Web : What Can Be Presented when Calibration isn ’ t Possible , 2001 .

[57]  Michael H Birnbaum,et al.  Web-based experiments controlled by JavaScript: An example from probability learning , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.