Focus groups in psychological assessment: enhancing content validity by consulting members of the target population.

A review of articles in Psychological Assessment reveals that many researchers develop instruments without the benefit of consultation with members of the target population. To the extent that researchers do consult the target population, most fail to bring consultation in early enough to inform the identification and specification of key constructs. Moreover, this consultation typically takes the form of one-to-one interviews. The authors' goal in this article was to elaborate on the importance of population consultation as part of content validation and to critically evaluate the potential of one method of consultation, focus groups, to inform multiple stages of instrument development. The authors suggest that this method holds promise for enhancing the content validity of instruments and, ultimately, the validity of research findings.

[1]  D. King,et al.  Measuring exposure to racism: development and validation of a Race-Related Stressor Scale (RRSS) for Asian American Vietnam veterans. , 2001, Psychological assessment.

[2]  P. Gray-Vickrey.  Gerontological research: use and application of focus groups. , 1993, Journal of gerontological nursing.

[3]  D. Watson,et al.  Constructing validity: Basic issues in objective scale development , 1995 .

[4]  Richard van Dyck,et al.  Construction and psychometric characteristics of two self-report questionnaires for the assessment of fear of flying. , 1999 .

[5]  J. Loevinger.  Objective Tests as Instruments of Psychological Theory , 1957 .

[6]  H. Hendin,et al.  Combat adaptations of Vietnam veterans without posttraumatic stress disorders. , 1984, The American journal of psychiatry.

[7]  Philip C. Kendall,et al.  Handbook of research methods in clinical psychology , 1982 .

[8]  Mai-Britt Herslund.  The Focus group Method , 2003 .

[9]  Samuel Messick,et al.  STANDARDS OF VALIDITY AND THE VALIDITY OF STANDARDS IN PERFORMANCE ASSESSMENT , 2005 .

[10]  Abraham R. Wagner,et al.  Gulf war. , 1991, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[11]  Suzanne R. Best,et al.  Predictors of posttraumatic stress disorder and symptoms in adults: a meta-analysis. , 2008, Psychological bulletin.

[12]  Lynda A. King,et al.  Role Conflict and Role Ambiguity: A Critical Assessment of Construct Validity , 1990 .

[13]  James V. Mitchell.  Measurement in the larger context: Critical current issues. , 1986 .

[14]  S. Wisniewski,et al.  Selecting, developing, and evaluating research instruments , 1999, Social Psychiatry and Psychiatric Epidemiology.

[15]  John Hunsley,et al.  Introduction to the special section on incremental validity and utility in clinical assessment. , 2003, Psychological assessment.

[16]  M. Lynn.  Determination and quantification of content validity. , 1986, Nursing research.

[17]  S. Haynes,et al.  Content validity in psychological assessment: A functional approach to concepts and methods. , 1995 .

[18]  Bobby J. Calder,et al.  Focus groups and the nature of qualitative marketing research. , 1977 .

[19]  S. Haynes,et al.  Development and validation of the Trauma-Related Guilt Inventory (TRGI). , 1996 .

[20]  J. Kitzinger,et al.  Developing Focus Group Research , 1999 .

[21]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[22]  S. Wetzler.  Measuring Mental Illness:Psychometric Assessment for Clinicians , 1989 .

[23]  E. Kubany,et al.  Development and validation of the sources of trauma-related guilt survey-war-zone version. , 1997, Journal of traumatic stress.

[24]  B. Whitley,et al.  Handbook for conducting research on human sexuality , 2002 .

[25]  M. Lynn,et al.  Reliability estimates: use and disuse. , 1985, Nursing research.

[26]  B. Green.  Psychosocial research in traumatic stress: An update , 1994 .

[27]  L. Sechrest.  Incremental Validity : a Recommendation , 1963 .

[28]  J. Morse.  Critical Issues in Qualitative Research Methods , 1993 .

[29]  D. Foy,et al.  Post-traumatic stress disorder in Vietnam combat veterans: Effects of traumatic violence exposure and military adjustment , 1988 .

[30]  E. B. Zechmeister,et al.  Research Methods in Psychology. , 1990 .

[31]  L. Michell,et al.  Combining focus groups and interviews: Telling how it is; telling how it feels. , 1999 .

[32]  J. P. Maloney,et al.  Posttraumatic stress disorder among Army Nurse Corps Vietnam veterans. , 1985, Journal of consulting and clinical psychology.

[33]  M. Reckase.  Test construction in the 1990s: Recent approaches every psychologist should know. , 1996 .

[34]  V. Tilden,et al.  Use of Qualitative Methods to Enhance Content Validity , 1990, Nursing research.

[35]  C. Farquhar,et al.  Are focus groups suitable for 'sensitive' topics? , 1999 .

[36]  Samuel Messick,et al.  THE STANDARD PROBLEM: MEANING AND VALUES IN MEASUREMENT AND EVALUATION , 1974 .

[37]  Kenneth L. Pike,et al.  Language in relation to a unified theory of the structure of human behavior, 2nd rev. ed. , 1967 .

[38]  Gregory T. Smith,et al.  Methodological considerations in the refinement of clinical assessment instruments. , 1995 .

[39]  K O'Brien,et al.  Using Focus Groups to Develop Health Surveys: An Example from Research on Social Relationships and AIDS-Preventive Behavior , 1993, Health education quarterly.

[40]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[41]  Lynda A. King,et al.  Validity issues in research on Vietnam veteran adjustment. , 1991, Psychological bulletin.

[42]  V. Kameoka,et al.  Ethnocultural issues in the assessment of psychopathology. , 1989 .

[43]  Richard A. Krueger,et al.  Moderating Focus Groups , 1997 .

[44]  R. MacCallum,et al.  The use of causal indicators in covariance structure models: some practical issues. , 1993, Psychological bulletin.

[45]  Heather C. Lench,et al.  Incremental validity of new clinical assessment measures. , 2003, Psychological assessment.

[46]  P. Pelto,et al.  Anthropological Research: The Structure of Inquiry , 1970 .

[47]  Jennifer Taub,et al.  Assessing the costs, benefits, cost-effectiveness, and cost-benefit of psychological assessment: we should, we can, and here's how. , 2003, Psychological assessment.

[48]  R. Powell,et al.  Focus Groups in Mental Health Research: Enhancing the Validity of User and Provider Questionnaires , 1996, The International journal of social psychiatry.

[49]  C. Basch.  Focus Group Interview: An Underutilized Research Technique for Improving Theory and Practice in Health Education , 1987, Health education quarterly.

[50]  D. Campbell.  Recommendations for APA test standards regarding construct, trait, or discriminant validity. , 1960 .

[51]  N. Breslau,et al.  Posttraumatic stress disorder: the etiologic specificity of wartime stressors. , 1987, The American journal of psychiatry.

[52]  R. Ursano,et al.  Emotional aftermath of the Persian Gulf War : veterans, families, communities, and nations , 1996 .

[53]  D. Morgan.  Successful Focus Groups: Advancing the State of the Art , 1993 .

[54]  D. Dewsbury,et al.  Research Methods in Psychology (2nd ed.). , 1986 .

[55]  S. Haynes,et al.  Specificity of Variables , 2000 .

[56]  R. Malgady,et al.  Cultural expression of psychiatric symptoms : Idioms of anger among Puerto Ricans , 1996 .

[57]  Kathryn L. Taylor,et al.  Clinical evaluation of a measure to assess combat exposure. , 1989 .

[58]  Paul E. Meehl,et al.  The dynamics of "structured" personality tests. , 2000 .

[59]  J. Kitzinger,et al.  Developing Focus Group Research: Politics, Theory and Practice , 1998 .

[60]  H. Suen.  Principles of test theories , 1990 .

[61]  B. Fagot.  Assessment of coercive parent discipline. , 1992 .

[62]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[63]  Radhika Chandiramani,et al.  Talking about sex , 1998 .

[64]  E. Paul.  Wounded healers: a summary of the Vietnam Nurse Veteran Project. , 1985 .

[65]  Jane Frankland,et al.  Some issues arising in the systematic analysis of focus group materials. , 1998 .

[66]  M. Frank-Stromborg,et al.  Reaction to the Diagnosis of Cancer Questionnaire: Development And Psychometric Evaluation , 1989, Nursing research.

[67]  B. Green,et al.  Psychosocial research in traumatic stress: an update. , 1994, Journal of traumatic stress.

[68]  Jo-Ellen Asbury,et al.  Overview of Focus Group Research , 1995 .

[69]  R. Stretch.  Posttraumatic stress disorder among U.S. Army Reserve Vietnam and Vietnam-era veterans. , 1985, Journal of consulting and clinical psychology.

[70]  Douglas N. Jackson,et al.  The dynamics of structured personality tests: 1971. , 1971 .

[71]  B. Golomb,et al.  A Review of the Scientific Literature as it Pertains to Gulf War Illnesses , 1998 .

[72]  Marit Netland.  Assessment of Exposure to Political Violence and Other Potentially Traumatizing Events. A Critical Review , 2001, Journal of traumatic stress.

[73]  C. Sherbourne,et al.  A Review of the Scientific Literature As It Pertains to Gulf War Illnesses , 1998 .

[74]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[75]  Daniel D. Blaine,et al.  Psychometric issues in assessment research. , 1999 .

[76]  H. Resnick,et al.  Assessment of rape-related posttraumatic stress disorder: Stressor and symptom dimensions. , 1991 .

[77]  Thomas L. Greenbaum.  handbook for focus group research , 1993 .

[78]  Giacomo Mauro DAriano.  The Handbook for Focus Group Research. , 1994 .

[79]  R. Lennox,et al.  Conventional wisdom on measurement: A structural equation perspective. , 1991 .

[80]  E. Kubany,et al.  Development and Validation of the Sources f Trauma-Related Guilt Survey—War-Zone Version , 1997, Journal of traumatic stress.

[81]  Stevan E. Hobfoll,et al.  Objective versus subjective measurement of stress and social support: combat-related reactions. , 1987, Journal of consulting and clinical psychology.

[82]  D. King,et al.  Psychological effects of military service in Vietnam: a meta-analysis. , 1987, Psychological bulletin.

[83]  Richard A. Krueger,et al.  Focus groups : a practical guide for applied research / by Richard A. Krueger , 1989 .

[84]  Kerth O’Brien,et al.  Improving survey questionnaires through focus groups. , 1993 .

[85]  D. King,et al.  Alternative representations of war zone stressors: relationships to posttraumatic stress disorder in male and female Vietnam veterans. , 1995, Journal of abnormal psychology.

[86]  D. Morgan.  Focus groups for qualitative research. , 1988, Hospital guest relations report.

[87]  S. Haynes,et al.  Principles and Practice of Behavioral Assessment , 1999 .

[88]  Richard A. Krueger,et al.  Analyzing and Reporting Focus Group Results , 1997 .