Situated Experiments in Organizations: Transplanting the Lab to the Field

Both laboratory and field experiments have limitations that likely account for the recent decline in their usage among organizational researchers. In this article, we introduce situated experiments as an experimental approach that optimizes the strengths of both laboratory and field experiments in organizational research while mitigating the weaknesses of each. We highlight four recently published studies using situated experiments. Drawing on these examples, we illustrate how the proper use of situated experiments can minimize threats to internal validity and ensure the ethical treatment of research participants.

[1]  Stan Lipovetsky,et al.  Generalized Latent Variable Modeling: Multilevel,Longitudinal, and Structural Equation Models , 2005, Technometrics.

[2]  Harry T. Reis,et al.  Publication Trends in JPSP: A Three-Decade Review , 1992 .

[3]  R. Zajonc.  SOCIAL FACILITATION. , 1965, Science.

[4]  I. Gottesman,et al.  Heritability of personality: a demonstration. , 1963, Psychological monographs.

[5]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[6]  T. Scandura,et al.  Research Methodology In Management: Current Practices, Trends, And Implications For Future Research , 2000 .

[7]  Giacomo Mauro DAriano.  Moral Maturity: Measuring the Development of Sociomoral Reflection. , 1992 .

[8]  D. Campbell,et al.  Unobtrusive Measures: Nonreactive Research in the Social Sciences , 1966 .

[9]  Daniel R. Ilgen,et al.  Team learning: collectively connecting the dots. , 2003, The Journal of applied psychology.

[10]  K. Gergen.  Social Psychology as History , 1973 .

[11]  L. Berkowitz,et al.  External validity is more than skin deep: Some answers to criticisms of laboratory experiments. , 1982 .

[12]  E. Diener,et al.  Ethics In Social And Behavioral Research , 1978 .

[13]  D. Mook,et al.  In defense of external invalidity. , 1983 .

[14]  Bobby J. Calder,et al.  Demand characteristics and three conceptions of the frequently deceived subject. , 1970 .

[15]  M. Megel,et al.  Research Design , 2019, Beiträge zur Landschafts- und Umweltplanung I Contributions to Landscape and Environmental Planning.

[16]  Robert S. Barcikowski,et al.  Statistical Power with Group Mean as the Unit of Analysis , 1981 .

[17]  R. Rosenthal,et al.  Covert communication in the psychological experiment. , 1967, Psychological bulletin.

[18]  Timothy D. Wilson,et al.  Experimentation in social psychology. , 1998 .

[19]  Joseph E. McGrath,et al.  Dilemmatics: The Study of Research Choices and Dilemmas , 1981 .

[20]  Robert D. Pritchard,et al.  Effects of perceptions of equity and inequity on worker performance and satisfaction. , 1972 .

[21]  Arthur C. McKinney.  Deceiving experimental subjects. , 1955 .

[22]  Joel Brockner,et al.  When is it “a pleasure to do business with you?” The effects of relative status, outcome favorability, and procedural fairness☆ , 2003 .

[23]  F. J. Roethlisberger,et al.  Management and the Worker , 1941 .

[24]  R F Boruch,et al.  Randomized Field Experiments for Program Planning, Development, and Evaluation , 1978, Evaluation quarterly.

[25]  Arie W. Kruglanski,et al.  The Human Subject in the Psychology Experiment: Fact and Artifact , 1975 .

[26]  Stephen G. West,et al.  Causal inference and generalization in field settings: Experimental and quasi-experimental designs. , 2000 .

[27]  N. Anderson,et al.  Handbook of Industrial, Work & Organizational Psychology , 2001 .

[28]  R. A. Jones,et al.  Research Methods in the Social and Behavioral Sciences , 1985 .

[29]  J. P. Graves,et al.  Experimentation and College Students in Social Psychology Research , 1976 .

[30]  Donal E. Carlston,et al.  A closer examination of subject roles. , 1980 .

[31]  Udo Konradt,et al.  Handbook of industrial, work and organizational psychology (Vol. 1: Personnel Psychology; Vol. 2: Organizational Psychology) , 2004 .

[32]  Jerald Greenberg,et al.  Who stole the money, and when? Individual and situational determinants of employee theft , 2002 .

[33]  W. Evan.  Organizational experiments: Laboratory and field research , 1971 .

[34]  R. L. Henshel,et al.  The purposes of laboratory experimentation and the virtues of deliberate artificiality. , 1980 .

[35]  Robert G. Jones,et al.  Tactics of ingratiation among leaders and subordinates in a status hierarchy. , 1963 .

[36]  J. R. Larson,et al.  Research strategies and tactics in industrial and organizational psychology. , 1990 .

[37]  Yun-Oh Whang,et al.  Account-giving for a corporate transgression influences moral judgment: when those who "spin" condone harm-doing. , 2003, The Journal of applied psychology.

[38]  B. Whitley.  Principles of research in behavioral science , 1996 .

[39]  Eugene F. Stone-Romero,et al.  Trends in Research Design and Data Analytic Strategies in Organizational Research , 1995 .

[40]  J. Brockner,et al.  An integrative framework for explaining reactions to decisions: interactive effects of outcomes and procedures. , 1996, Psychological bulletin.

[41]  N. Triplett,et al.  The Dynamogenic Factors in Pacemaking and Competition , 1898 .

[42]  E. Mayo.  The Human Problems of an Industrial Civilization , 1934, Nature.

[43]  Kristine M. Kuhn,et al.  Variable pay as a risky choice: Determinants of the relative attractiveness of incentive plans , 2003 .

[44]  Earl R. Babbie,et al.  The practice of social research , 1969 .

[45]  M. D. Dunnette.  Handbook of Industrial and Organizational Psychology , 2005 .

[46]  R. Golembiewski.  Handbook of Organizational Behavior , 2001 .

[47]  D B Kopans,et al.  Screening for breast cancer and mortality reduction among women 40–49 years of age , 1994, Cancer.

[48]  J. Matarazzo,et al.  Interviewee Speech Behavior Under Different Content Conditions. , 1970 .

[49]  S. Jones,et al.  Worker interdependence and output: The Hawthorne studies reevaluated. , 1990 .

[50]  D. Baumrind,et al.  Research using intentional deception. Ethical issues revisited. , 1985, The American psychologist.

[51]  J. Greenberg,et al.  Stealing in the Name of Justice: Informational and Interpersonal Moderators of Theft Reactions to Underpayment Inequity , 1993 .

[52]  Merrill Carlsmith.  Methods of research in social psychology , 1976 .

[53]  S. Milgram.  BEHAVIORAL STUDY OF OBEDIENCE. , 1963, Journal of abnormal psychology.

[54]  M. Brewer,et al.  Research Design and Issues of Validity , 2000 .

[55]  R. Eric Landrum,et al.  Protecting human subjects : departmental subject pools and institutional review boards , 1999 .

[56]  John P. Gluck,et al.  Deception in Psychological Research , 1995, Kennedy Institute of Ethics journal.

[57]  R. Folger,et al.  Controversial issues in social research methods , 1987 .

[58]  G. Nicholas Braucht,et al.  A Computerized Approach To Trickle-Process, Random Assignment , 1993 .

[59]  M. Gordon,et al.  The “Science of the Sophomore” Revisited: from Conjecture to Empiricism , 1986 .

[60]  Gerald R. Ferris,et al.  Method and analysis in organizational research , 1984 .

[61]  Neil Anderson.  Handbook of industrial, work and organizational psychology. 2: Organizational psychology , 2001 .

[62]  Harrison Si,et al.  Handbook of Research Methods in Social and Personality Psychology: Author Index , 2013 .