“They'll Change What They're Doing If They Know that You're Watching”: Measuring Reactivity in Health Behavior Because of an Observer's Presence— A Case from the Peruvian Amazon

Social scientists often employ direct observation to study human behavior, but a health researcher who proposes it may face considerable skepticism from colleagues. Concerns about reactivity lead many to question the validity of observational data. Because few studies have measured reactivity, evidence to evaluate this concern is limited. The authors report results from their systematic measurement of reactivity during a Peruvian malaria prevention study. In sixty observations over nine months, observers recorded all behavior they perceived as potentially reactive. The authors then assessed reactivity using iterative coding and analysis. Although they documented 339 reactivity episodes, only two involved behaviors related to study objectives. These findings are consistent with prior research and provide additional evidence that reactivity, though common, need not bias study results. The authors suggest strategies for assessing reactivity that can help reassure skeptics and reinforce the validity of observational data.

[1]  R. Spano How does reactivity affect police behavior? Describing and quantifying the impact of reactivity as behavioral change in a large-scale observational study of police , 2007 .

[2]  S. Harvey,et al.  The whole world will be able to see us: Cultural factors affecting insecticide-treated bed net use for malaria control in the Peruvian Amazon , 2007 .

[3]  S. Simmons,et al.  Direct observations of nursing home care quality: Does care change when observed? , 2006, Journal of the American Medical Directors Association.

[4]  R. Spano Observer Behavior as a Potential Source of Reactivity: Describing and Quantifying Observer Effects in a Large-Scale Observational Study of Police , 2006 .

[5]  S. Cairncross,et al.  Childhood diarrhea and observed hygiene behavior in Salvador, Brazil. , 2003, American journal of epidemiology.

[6]  M. Ruel,et al.  Spot-check observational method for assessing hygiene practices: review of experience and implications for programmes. , 2002, Journal of health, population, and nutrition.

[7]  R. Emerson Contemporary Field Research : Perspectives and Formulations , 2001 .

[8]  H. Russell Bernard,et al.  Social Research Methods: Qualitative and Quantitative Approaches , 2000 .

[9]  F. Gardner Methodological Issues in the Direct Observation of Parent–Child Interaction: Do Observational Findings Reflect the Natural Behavior of Participants? , 2000, Clinical child and family psychology review.

[10]  S. Blumenfeld,et al.  Methodology matters. Comparative validity of three methods for assessment of the quality of primary health care , 1999 .

[11]  K C Stange,et al.  How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patients visits. , 1998, Medical care.

[12]  S. Cousens,et al.  Measuring hygiene practices: a comparison of questionnaires with direct observations in rural Zaïre , 1997, Tropical medicine & international health : TM & IH.

[13]  Joel Gittelsohn,et al.  Estimating reactivity in direct observation studies of health behaviors , 1997 .

[14]  S. Cousens,et al.  Reactivity and repeatability of hygiene behaviour: structured observations from Burkina Faso. , 1996, Social science & medicine.

[15]  R. Scaglion the importance of nighttime observations in time allocation studies , 1986 .

[16]  Z. Gussow THE OBSERVER-OBSERVED RELATIONSHIP AS INFORMATION ABOUT STRUCTURE IN SMALL-GROUP RESEARCH; A COMPARATIVE STUDY OF URBAN ELEMENTARY SCHOOL CLASSROOMS. , 1964, Psychiatry.

[17]  David L. Altheide,et al.  Criteria for assessing interpretive validity in qualitative research. , 1994 .

[18]  S. Cousens,et al.  Structured observations of hygiene behaviours in Burkina Faso: validity, variability, and utility. , 1993, Bulletin of the World Health Organization.

[19]  K. Aziz,et al.  Twenty-four-hour recall, knowledge-attitude-practice questionnaires, and direct observations of sanitary practices: a comparative study. , 1987, Bulletin of the World Health Organization.

[20]  P. Killworth,et al.  The Problem of Informant Accuracy: The Validity of Retrospective Data , 1984 .

[21]  M. Clarke Survival in the field: Implications of personal experience in field work , 1975 .