Using the Internet to collect data

The Internet is not one single, monolithic medium. It consists of many services with different functions and needs for input, even more so than the medium telephone varies between clunky devices made from wood that we sometimes see in old movies, the iPad, smartphones, and Voice over Internet Protocol.1 Using the Internet can mean writing and receiving e-mails that may be purely text based or rich in media. It can mean to surf using a Web browser on a desktop computer, laptop, or smartphone. Driving a car often automatically means using the Internet, as information about the location of the car is sent to satellites and databases connected via the Internet. The Internet of Things, one of the next steps in the Internet revolution, will connect more and more of the world to the Internet. This connection can be made by the average person with the help of services like http://www.touchatag.com. According to the Gartner Group, by the end of 2012, physical sensors will generate 20% of nonvideo Internet traffic: “The extent and diversity of real-time environmental sensing is growing rapidly as our ability to act on and interpret the growing volumes of data to capture valuable information increases” (Plummer et al., 2009). Universal addressability of things and people (sometimes called the Semantic Web; Berners-Lee, Hendler, & Lassila, 2001; World Wide Web Consortium [W3C], 2010) allows Internet-based data collection even about people and things that are not connected to the Internet.2 Other agents refer to them by sending their location, images, and so on. A case vividly demonstrating this principle is Google Street View: Combining location information with panoramic images creates a highly informative and immersive tool to explore the world at a human scale (i.e., with the eyes of a traveler). The future combination of visual location information with the Internet of Things will create an increasingly tightly meshed representation of the world on the Internet. This chapter shows the major steps in collecting data on the Internet. The first section, InternetBased Research, narrates the short history of Internet-based data-collection methods in psychological research, describes their characteristics, and presents a systematic overview of the four basic types of methods. Some notions about planning Internetbased research lead to the second section, Generating a Web Experiment. The section describes an example and provides the reader with the opportunity to become active and experience Internet-based data-collection methods by creating and conducting a Web experiment in a step-by-step fashion. The example introduces the important concepts of client-side versus server-side processing and illustrates a number of important techniques. The third section, Pre-Testing, emphasizes the need to take extra care in preparing the materials and procedure and

[1]  James A. Hendler,et al.  A new form of Web content that is meaningful to computers will unleash a revolution of new possibili , 2002 .

[2]  Ulf-Dietrich Reips Chapter 4 – The Web Experiment Method: Advantages, Disadvantages, and Solutions , 2000 .

[3]  Anja S. Göritz,et al.  Incentives in Web Studies: Methodological Issues and a Review , 2006 .

[4]  Stefan Stieger,et al.  Internet users' perceptions of 'privacy concerns' and 'privacy actions' , 2007, Int. J. Hum. Comput. Stud..

[5]  Jeremy Ginsberg,et al.  Detecting influenza epidemics using search engine query data , 2009, Nature.

[6]  Daniel P. Dern Privacy Concerns , 2003, IEEE Security & Privacy Magazine.

[7]  Ulf-Dietrich Reips,et al.  TheWeb Experiment List: A web service for the recruitment of participants and archiving of Internet-based experiments , 2005, Behavior research methods.

[8]  Stefan Stieger,et al.  What are participants doing while filling in an online questionnaire: A paradata collection tool and an empirical study , 2010, Comput. Hum. Behav..

[9]  Stefan Stieger,et al.  The high-hurdle technique put to the test: Failure to find evidence that increasing loading times enhances data quality in Web-based studies , 2008, Behavior research methods.

[10]  John A. Johnson,et al.  Implementing a five-factor personality inventory for use on the internet , 2005 .

[11]  E. Erdfelder,et al.  Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses , 2009, Behavior research methods.

[12]  Ulf-Dietrich Reips,et al.  Design and Formatting in Internet-Based Research , 2010 .

[13]  Anja S Göritz,et al.  Building and managing an online panel with phpPanelAdmin , 2009, Behavior research methods.

[14]  Ulf-Dietrich Reips,et al.  A Brief History of Web Experimenting , 2000 .

[15]  H. Honing,et al.  The potential of the Internet for music perception research: A comment on lab-based versus Web-based studies , 2008 .

[16]  Ulf-Dietrich Reips,et al.  Conducting true experiments on the web , 2010 .

[17]  Stefan Stieger,et al.  Dynamic Interviewing Program (DIP): Automatic Online Interviews via the Instant Messenger ICQ , 2008, Cyberpsychology Behav. Soc. Netw..

[18]  U D Reips The Web Experimental Psychology Lab: Five years of data collection on the Internet , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[19]  Mirina Grosz,et al.  World Wide Web Consortium , 2010 .

[20]  Roger A. Kendall Commentary on "The Potential of the Internet for Music Perception Research: A Comment on Lab-Based Versus Web- Based Studies" by Honing & Ladinig , 2008 .

[21]  Ulf-Dietrich Reips Standards for Internet-based experimenting. , 2002, Experimental psychology.

[22]  Samuel D. Gosling,et al.  Advanced Methods for Conducting Online Behavioral Research , 2010 .

[23]  Martin Voracek,et al.  Forced-response in online surveys: Bias from reactance and an increase in sex-specific dropout , 2007, J. Assoc. Inf. Sci. Technol..

[24]  Michael H. Birnbaum,et al.  Designing online experiments , 2009 .

[25]  Katelyn Y. A. McKenna,et al.  Oxford Handbook of Internet Psychology , 2007 .

[26]  Tom Buchanan,et al.  Online personality assessment , 2001 .

[27]  John L. Smith,et al.  Research on the Internet: Validation of a World-Wide Web mediated personality scale , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[28]  Ulf-Dietrich Reips,et al.  Sleep, sex, and the Web: Surveying the difficult-to-reach clinical population suffering from sexsomnia , 2007, Behavior research methods.

[29]  N. Askitas,et al.  Google Econometrics and Unemployment Forecasting , 2009, SSRN Electronic Journal.

[30]  John H. Krantz,et al.  Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness , 1997 .

[31]  N. Troop,et al.  Online longitudinal survey research: viability and participation , 2002 .

[32]  Ulf-Dietrich Reips,et al.  Theory and Techniques of Conducting Web Experiments , 2002 .

[33]  Ulf-Dietrich Reips,et al.  Context Effects in Web Surveys , 2002 .

[34]  Adam N. Joinson,et al.  Personalized salutation, power of sender and response rates to Web-based surveys , 2007, Comput. Hum. Behav..

[35]  Ulf-Dietrich Reips,et al.  Das psychologische Experimentieren im Internet , 1997 .

[36]  Wolfgang Bandilla,et al.  Banner-advertised web surveys , 2000 .

[37]  Ulf-Dietrich Reips,et al.  27 Behavioral Research and Data Collection via the Internet , 2005 .

[38]  Ulf-Dietrich Reips,et al.  WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[39]  Ulf-Dietrich Reips,et al.  Web-Based Methods , 2006 .

[40]  E. Leeuw,et al.  To mix or not to mix data collection modes in surveys. , 2005 .

[41]  Kate E Decleene,et al.  Publication Manual of the American Psychological Association , 2011 .

[42]  Immo Fritsche,et al.  Nonreactive Methods in Psychological Research. , 2006 .

[43]  Tom Buchanan,et al.  Personality testing on the Internet: what we know and what we do not , 2007 .

[44]  Ulf-Dietrich Reips,et al.  Why Semantic Differentials in Web-Based Research Should Be Made from Visual Analogue Scales and Not from 5-Point Scales , 2012 .

[45]  John E. Williams,et al.  Using graphics, photographs, and dynamic media. , 2010 .

[46]  Ulf-Dietrich Reips,et al.  Financial Incentives, Personal Information and Drop Out in Online Studies , 2001 .

[47]  Ulf-Dietrich Reips,et al.  Mining twitter: A source for psychological wisdom of the crowds , 2011, Behavior research methods.

[48]  Stian Reimers,et al.  The BBC Internet Study: General Methodology , 2007, Archives of sexual behavior.

[49]  Birk Diedenhofen,et al.  Seriousness checks are useful to improve data validity in online research , 2012, Behavior Research Methods.

[50]  Ulf-Dietrich Reips,et al.  Online Social Sciences , 2002 .

[51]  Anja S. Göritz,et al.  Using Online Panels in Psychological Research , 2009 .

[52]  Michael A. Smith,et al.  Virtual subjects: Using the Internet as an alternative source of subjects and research environment , 1997 .

[53]  M. Birnbaum Decision Making in the Lab and on the Web , 2000 .

[54]  J. Brehm A theory of psychological reactance. , 1981 .

[55]  Ulf-Dietrich Reips,et al.  Sliders for the Smart: Type of Rating Scale on the Web Interacts With Educational Level , 2011 .

[56]  Lora Aroyo,et al.  The NoTube Beancounter: Aggregating User Data for television Programme Recommendation , 2009, ISWC 2009.

[57]  Jolene D. Smyth,et al.  Effects of Using Visual Design Principles to Group Response Options in Web Surveys , 2006 .

[58]  William C. Schmidt,et al.  Technical considerations when implementing online research , 2009 .

[59]  Stefan Stieger,et al.  Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[60]  Ulf-Dietrich Reips,et al.  Interval-level measurement with visual analogue scales in Internet-based research: VAS Generator , 2008, Behavior research methods.

[61]  F. Preckel,et al.  Online- versus paper-pencil-version of a high potential intelligence test , 2003 .

[62]  Eckart Altenmüller,et al.  Continuous Measurement of Musically-Induced Emotion: A Web Experiment , 2009 .

[63]  Ulf-Dietrick Reips,et al.  Internet-Based Psychological Experimenting , 2002 .

[64]  Angela P. Wetzel Internet, mail, and mixed‐mode surveys: The tailored design method , 2010 .

[65]  Martin Voracek,et al.  Forced-response in online surveys: Bias from reactance and an increase in sex-specific dropout , 2007, J. Assoc. Inf. Sci. Technol..

[66]  Dietmar Janetzko,et al.  NET Objectivity , Reliability , and Validity of Search Engine Count Estimates , 2008 .

[67]  John H. Krantz,et al.  Stimulus Delivery on the Web : What Can Be Presented when Calibration isn ’ t Possible , 2001 .

[68]  Henkjan Honing,et al.  Web-based versus lab-based studies: A response to Kendall (2008) , 2008 .

[69]  William C. Schmidt,et al.  The Server Side of Psychology Web Experiments , 2000 .

[70]  Roger E. Kirk,et al.  Experimental design: Procedures for the behavioral sciences (3rd ed.). , 1995 .

[71]  Huajun Chen,et al.  The Semantic Web , 2011, Lecture Notes in Computer Science.

[72]  Ulf-Dietrich Reips,et al.  The methodology of Internet-based experiments , 2009 .