The internet as psychological laboratory.

This chapter reviews studies published in American Psychological Association (APA) journals from 2003-2004 and additional studies (received in response to listserv requests) that used the Internet to collect data (N=121 total studies). Specific examples of three kinds of Web-based research are reviewed: (a) translational (established methods and research questions are adapted to the Web), (b) phenomenological (behavior on the Web is the focus of study), and (c) novel (methodologically innovations unique to Web-based research). Among other findings, our review indicated that 21% of APA journals published at least one article that reported on Web-based research, most Web-based psychological research uses experimental methods, a surprising number use college student samples, and deception in Web-based research is not uncommon. Strengths and weaknesses of Web-based psychological research in general, and our sample of studies in particular, are reviewed with special attention to possible concerns about sampling and the use of deception.

[1]  J. Musch,et al.  Online auctions as a research tool : A field experiment on ethnic discrimination , 2003 .

[2]  Christopher W. Bauman,et al.  Political Tolerance and Coming to Psychological Closure Following the September 11, 2001, Terrorist Attacks: An Integrative Approach , 2004, Personality & social psychology bulletin.

[3]  J. Eichstaedt,et al.  Measuring differences in preactivation on the Internet: the content category superiority effect. , 2002, Experimental psychology.

[4]  Katelyn Y. A. McKenna,et al.  The internet and social life. , 2004, Annual review of psychology.

[5]  K. Williams,et al.  Cyberostracism: effects of being ignored over the Internet. , 2000, Journal of personality and social psychology.

[6]  Elisheva F. Gross,et al.  Internet Use and Well-Being in Adolescence , 2002 .

[7]  W. Keith Campbell,et al.  Individual differences in narcissism: Inflated self-views across the lifespan and around the world , 2003 .

[8]  Itamar Simonson,et al.  The effect of accountability on susceptibility to decision errors , 1992 .

[9]  L. Newman,et al.  Understanding genocide : the social psychology of the Holocaust , 2002 .

[10]  Steven E. Stern,et al.  The lost e-mail method: Milgram’s lost-letter technique in the age of the Internet , 1997 .

[11]  G. Eysenbach,et al.  Ethical issues in qualitative research on internet communities , 2001, BMJ : British Medical Journal.

[12]  E. Singer,et al.  The effects of response rate changes on the index of consumer sentiment. , 2000, Public opinion quarterly.

[13]  David C. Evans,et al.  In the Privacy of Their Own Homes: Using the Internet to Assess Racial Bias , 2003, Personality & social psychology bulletin.

[14]  P. Tetlock.  Accountability and the perseverance of first impressions. , 1983 .

[15]  R. Cialdini,et al.  Online persuasion: An examination of gender differences in computer-mediated interpersonal influence. , 2002 .

[16]  S. Gosling,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES The Do Re Mi’s of Everyday Life: The Structure and Personality Correlates of Music Preferences , 2003 .

[17]  M. Birnbaum.  Human research and data collection via the internet. , 2004, Annual review of psychology.

[18]  S. Kiesler,et al.  Group processes in computer-mediated communication☆ , 1986 .

[19]  P. Zimbardo.  The human choice: Individuation, reason, and order versus deindividuation, impulse, and chaos. , 1969 .

[20]  D. Gustafson,et al.  COMPARISONS: PROFESSIONALLY-DIRECTED AND SELF-DIRECTED INTERNET GROUPS FOR WOMEN WITH BREAST CANCER , 2005 .

[21]  Linda J. Skitka,et al.  Understanding Judgments of Fairness in a Real-World Political Context: A Test of the Value Protection Model of Justice Reasoning , 2002 .

[22]  Katelyn Y. A. McKenna,et al.  Coming Out in the Age of the Internet: Identity “Demarginalization” Through Virtual Group Participation , 1998 .

[23]  O. Wilhelm,et al.  The meaning(s) of conditionals: conditional probabilities, mental models, and personal utilities. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[24]  Marcy M. Allen,et al.  The Ever-Shifting Internet Population: A New Look At Internet Access and the Digital Divide, Amanda Lenhart (Ed.). The Pew Internet & American Life Project, Washington, DC (2003) , 2005, Gov. Inf. Q..

[25]  J. I. Kim,et al.  Accountability and judgment processes in a personality prediction task. , 1987, Journal of personality and social psychology.

[26]  Brian A. Nosek,et al.  Harvesting implicit group attitudes and beliefs from a demonstration web site , 2002 .

[27]  S. Gosling,et al.  e-Perceptions : Personality Impressions Based on Personal Websites , 2004 .

[28]  Judy Eaton,et al.  Using the Internet for Organizational Research: A Study of Cynicism in the Workplace , 2002, Cyberpsychology Behav. Soc. Netw..

[29]  Dawn Iacobucci,et al.  Advancing Alpha: Measuring Reliability with Confidence , 2003 .

[30]  Reeshad S. Dalal,et al.  Validity of Web-Based Psychological Research , 2000 .

[31]  Erika A. Waters,et al.  Formats for Improving Risk Communication in Medical Tradeoff Decisions , 2006, Journal of health communication.

[32]  Kenneth J. Malmberg,et al.  The effect of normative context variability on recognition memory. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[33]  Jessica L. Tracy,et al.  Personality Correlates of Self-Esteem , 2001 .

[34]  Cassandra L. Govan,et al.  Investigations into differences between social- and cyberostracism. , 2002 .

[35]  Jonathon N. Cummings,et al.  Internet Paradox Revisited , 2002 .

[36]  Gerhard Andersson,et al.  Internet-based treatment for insomnia: a controlled evaluation. , 2004, Journal of consulting and clinical psychology.

[37]  Katelyn Y. A. McKenna,et al.  Relationship formation on the Internet: What's the big attraction? , 2002 .

[38]  Jonathon N. Cummings,et al.  Beyond hearing: Where the real-world and online support meet. , 2002 .

[39]  Anita L. Blanchard.  Virtual Behavior Settings: An Application of Behavior Setting Theories to Virtual Communities , 2006, J. Comput. Mediat. Commun..

[40]  S. Gosling,et al.  Development of personality in early and middle adulthood: set like plaster or persistent change? , 2003, Journal of personality and social psychology.

[41]  Jeroen Vaes,et al.  On the behavioral consequences of infrahumanization: the implicit role of uniquely human emotions in intergroup relations. , 2003, Journal of personality and social psychology.

[42]  Humphrey Taylor,et al.  Does Internet Research Work? , 2000 .

[43]  Margarete Boos,et al.  Attitude Change in Computer-Mediated Communication: Effects of Anonymity and Category Norms , 2003 .

[44]  Cassandra L. Govan,et al.  Investigations into differences between social- and cyberostracism. , 2002 .

[45]  H. Kelman,et al.  Human use of human subjects: the problem of deception in social psychological experiments. , 1967, Psychological bulletin.

[46]  Nicolas Guéguen,et al.  Fund-Raising on the Web: The Effect of an Electronic Foot-in-the-Door on Donation , 2001, Cyberpsychology Behav. Soc. Netw..

[47]  R. Spears,et al.  Panacea or Panopticon? , 1994 .

[48]  P. Tetlock.  Accountability: A social check on the fundamental attribution error. , 1985 .

[49]  Robin M. Mathy,et al.  Methodological Rigor with Internet Samples: New Ways to Reach Underrepresented Populations , 2002, Cyberpsychology Behav. Soc. Netw..

[50]  M. Couper.  A REVIEW OF ISSUES AND APPROACHES , 2000 .

[51]  R. Chris Fraley.  How to conduct behavioral research over the Internet , 1992 .

[52]  S. Gosling,et al.  An integrative approach to personality research in anthrozoology: Ratings of six species of pets and their owners , 1998 .

[53]  Samuel D Gosling,et al.  Global self-esteem across the life span. , 2002, Psychology and aging.

[54]  Fritz Drasgow,et al.  A Meta-Analytic Study of Social Desirability Distortion in Computer- Administered Questionnaires, Traditional Questionnaires, and Interviews , 1999 .

[55]  D. Russell,et al.  Cultural Equivalence of Adult Attachment Across Four Ethnic Groups: Factor Structure, Structured Means, and Associations With Negative Mood , 2004 .

[56]  P. Emmelkamp,et al.  Interapy: a controlled randomized trial of the standardized treatment of posttraumatic stress through the internet. , 2003, Journal of consulting and clinical psychology.

[57]  Storm A. King,et al.  Researching Internet Communities: Proposed Ethical Guidelines for the Reporting of Results , 1996, Inf. Soc..

[58]  C. Zogmaister,et al.  Exemplar activation and interpersonal behavior , 2001 .

[59]  Sara Kiesler,et al.  Social psychological aspects of computer-mediated communication , 1984 .

[60]  P. Tetlock,et al.  Accounting for the effects of accountability. , 1999, Psychological bulletin.

[61]  Michael H. Birnbaum,et al.  Introduction to Behavioral Research on the Internet , 2000 .

[62]  Tom Postmes,et al.  Social identity, normative content, and "deindividuation" in computer-mediated groups , 1999 .

[63]  R. L. Rosnow,et al.  Rumor rest stops on the information highway: Transmission patterns in a computer-mediated rumor chain , 1998 .

[64]  Robert E. Kraut,et al.  Internet paradox. A social technology that reduces social involvement and psychological well-being? , 1998, The American psychologist.

[65]  Virginia Gil-Rivas,et al.  Nationwide longitudinal study of psychological responses to September 11. , 2002, JAMA.

[66]  T. Judge,et al.  Affect and job satisfaction: a study of their relationship at work and at home. , 2004, The Journal of applied psychology.

[67]  R M Groves,et al.  Consequences of reducing nonresponse in a national telephone survey. , 2000, Public opinion quarterly.

[68]  D. O. Sears.  College sophomores in the laboratory: Influences of a narrow data base on social psychology's view of human nature. , 1986 .

[69]  M H Birnbaum,et al.  SurveyWiz and factorWiz: Javascript Web pages that make HTML forms for research on the internet , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[70]  Katelyn Y. A. McKenna,et al.  Plan 9 From Cyberspace: The Implications of the Internet for Personality and Social Psychology , 2000 .

[71]  Sara B. Kiesler,et al.  The Equalization Phenomenon: Status Effects in Computer-Mediated and Face-to-Face Decision-Making Groups , 1991, Hum. Comput. Interact..

[72]  Al Cooper,et al.  Sex on the internet: furthering our understanding of men with online sexual problems. , 2004, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[73]  Leslie Lenert,et al.  Research Paper: Automated E-mail Messaging as a Tool for Improving Quit Rates in an Internet Smoking Cessation Intervention , 2004, J. Am. Medical Informatics Assoc..

[74]  K. McGraw,et al.  The Integrity of Web-Delivered Experiments: Can You Trust the Data? , 2000, Psychological science.

[75]  K. McGraw,et al.  A common language effect size statistic. , 1992 .

[76]  Lee M Ritterband,et al.  An Internet intervention as adjunctive therapy for pediatric encopresis. , 2003, Journal of consulting and clinical psychology.

[77]  G. Horstmann.  What do facial expressions convey: feeling states, behavioral intentions, or action requests? , 2003, Emotion.

[78]  Jerry Finn,et al.  Computer-Based Self-Help Groups for Sexual Abuse Survivors , 1994 .

[79]  Deborah Ruth Richardson,et al.  Amelioration of deception and harm in psychological research: The important role of debriefing , 1983 .

[80]  Ulf-Dietrich Reips,et al.  A Brief History of Web Experimenting , 2000 .

[81]  Nicolas Guéguen,et al.  Social Presence Reinforcement and Computer-Mediated Communication: The Effect of the Solicitor's Photography on Compliance to a Survey Request Made by E-Mail , 2002, Cyberpsychology Behav. Soc. Netw..

[82]  D. Green,et al.  Studying Hate Crime with the Internet: What Makes Racists Advocate Racial Violence? , 2002 .

[83]  T. Postmes,et al.  Social Influence in Computer-Mediated Communication: The Effects of Anonymity on Group Behavior , 2001 .