Risk assessment in context

Abstract This article provides an overview of the context in which decisions about risk are made in child welfare including personal, task, and environmental factors that may contribute to uncertainty and less-than-optimal decision making, as well as some of the methodological challenges posed by the use of current risk assessment instruments. Actuarial, consensus-based, and clinical instruments are discussed and the more successful track record of actuarial decision-making in child welfare and related fields is highlighted. Methodological challenges to assessing risk are also presented including lack of reliability and validity of measures, definitional dilemmas, temporal issues such as changes in risk over time, absence of base rate data, predicting for individuals and sensitivity and specificity of measures. Implications for the design and implementation of risk assessment tools are considered in light of contextual influences and methodological limitations. Lastly, an overview of the contents of Part One of this special issue on risk assessment is provided.

[1]  D. Lindsey.  Mandated reporting and child abuse fatalities: requirements for a system to protect children. , 1994, Social work research.

[2]  P. Meehl,et al.  Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical–statistical controversy. , 1996 .

[3]  T. Healy,et al.  Risk assessment in child protective services: consensus and actuarial model reliability. , 1999, Child welfare.

[4]  P. Meehl.  Why I Do Not Attend Case Conferences , 1973 .

[5]  D. Bronson,et al.  Evaluating risk assessment implementation in child protection: issues for consideration. , 1992, Child abuse & neglect.

[6]  Steve Selvin,et al.  Statistical Analysis of Epidemiologic Data , 1991 .

[7]  J. Gray,et al.  Evidence-Based Healthcare: How to Make Health Policy and Management Decisions , 2001 .

[8]  M. Woolverton,et al.  Risk assessment: the emperor's new clothes? , 1990, Child welfare.

[9]  D. Lindsey.  Factors affecting the foster care placement decision: an analysis of national survey data. , 1991, The American journal of orthopsychiatry.

[10]  O. Geling,et al.  Statistical estimation of child abuse rates from administrative databases , 2000 .

[11]  D. Lindsey.  Reliability of the Foster Care Placement Decision: A Review , 1992 .

[12]  Diana J. English,et al.  An examination of relationships between children's protective services social worker assessment of risk and independent LONGSCAN measures of risk constructs , 2000 .

[13]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[14]  J. Ruscio,et al.  Information Integration in Child Welfare Cases: An Introduction to Statistical Decision Making , 1998 .

[15]  G. Taubes.  Epidemiology faces its limits. , 1995, Science.

[16]  J. Kagan,et al.  Rational choice in an uncertain world , 1988 .

[17]  E. Gambrill,et al.  The need for comprehensive risk management systems in child welfare , 2001 .

[18]  Christopher W. Baird,et al.  The relative validity of actuarial- and consensus-based risk assessment systems , 2000 .

[19]  W. Meezan,et al.  Variations in perceptions of child neglect. , 1996, Child welfare.

[20]  E. Gambrill.  Critical thinking in clinical practice : improving the accuracy of judgments and decisions about clients , 1990 .

[21]  S. Wells,et al.  Predictors of maltreatment recurrence at two milestones in the life of a case , 2001 .

[22]  L. Margolin.  Under the Cover of Kindness: The Invention of Social Work , 1997 .

[23]  William M. Grove,et al.  Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures , 1996 .

[24]  Charles Vincent,et al.  Clinical risk management , 1995 .

[25]  R. Dawes,et al.  Heuristics and Biases: Clinical versus Actuarial Judgment , 2002 .

[26]  P. Pecora.  Investigating Allegations of Child Maltreatment:: The Strengths and Limitations of Current Risk Assessment Systems , 1991 .

[27]  M. Camasso,et al.  Prediction accuracy of the Washington and Illinois risk assessment instruments: an application of receiver operating characteristic curve analysis. , 1995, Social work research.

[28]  J. Klayman.  Varieties of Confirmation Bias , 1995 .

[29]  S. Zuravin.  Child Neglect: A Review of Definitions and Measurement Research , 1999 .

[30]  David T. Lykken,et al.  What's wrong with Psychology, anyway? , 1991 .

[31]  P. Meehl.  Psychodiagnosis: Selected Papers , 1973 .

[32]  B. Drake.  Predictors of Preventive Services Provision among Unsubstantiated Cases , 1996 .

[33]  Peter Lyons,et al.  Risk Assessment for Child Protective Services: A Review of the Empirical Literature on Instrument Performance. , 1996 .

[34]  L. Ashby.  The politics of child abuse in America , 1996, History of Education Quarterly.

[35]  H. Dubowitz.  Neglected Children: Research, Practice, and Policy , 1999 .

[36]  R. Dingwall,et al.  The Protection of Children: State Intervention and Family Life , 1995 .

[37]  I. Janis.  Groupthink: Psychological Studies of Policy Decisions and Fiascoes , 1982 .

[38]  Radha Jagannathan,et al.  Modeling the reliability and predictive validity of risk assessment in child protective services , 2000 .

[39]  R. Dawes,et al.  House of Cards: Psychology and Psychotherapy Built on Myth. , 1995 .

[40]  T. Mcdonald,et al.  A Review of Risk Factors Assessed in Child Protective Services , 1991, Social Service Review.

[41]  I. Wolock,et al.  Child abuse and neglect referral patterns: A longitudinal study , 2001 .

[42]  S. Zuravin,et al.  Rates, Patterns, and Frequency of Child Maltreatment Recurrences among Families known to CPS , 1998 .

[43]  Charles Gene Lyle,et al.  Looks can be deceiving: Using a risk assessment instrument to evaluate the out-comes of child protection services , 2000 .

[44]  Leroy H. Pelton,et al.  For Reasons of Poverty: A Critical Analysis of the Public Child Welfare System in the United States , 1989 .

[45]  D. Finkelhor,et al.  Coping with Family Violence: Research and Policy Perspectives , 1988 .

[46]  D. Medin,et al.  Decision making from a cognitive perspective , 1995 .

[47]  S. Zuravin,et al.  Assessing risk to determine the need for services , 2001 .

[48]  D. English,et al.  Characteristics of Repeated Referrals to Child Protective Services in Washington State , 1999 .

[49]  R. Serlin,et al.  Misuse of statistical test in three decades of psychotherapy research. , 1994, Journal of consulting and clinical psychology.

[50]  R. Barth,et al.  Child welfare research review , 1994 .