Reliability of the Colorado Family Support Assessment

Purpose: Family support programs commonly use self-sufficiency matrices (SSMs) to measure family outcomes, however, validation research on SSMs is sparse. This study examined the reliability of the Colorado Family Support Assessment 2.0 (CFSA 2.0) to measure family self-reliance across 14 domains (e.g., employment). Methods: Ten written case studies were developed. Family advocates (n = 24) independently coded each case study on each domain of the CFSA 2.0. Intraclass correlation (ICC) coefficients were calculated to determine the level of agreement between participants. Rating accuracy was calculated by subtracting the correct score for each domain and case study from the score given by the raters. Results: ICCs ranged from .79 to .96. Across all domains and case studies, family advocates were 84.4% accurate. Allowing for minor deviations (off by 1 on the 5-point scale) shows 96% accuracy. Discussion: A well-constructed SSM can be used to collect reliable and objective data on family self-sufficiency.

[1]  Carmen DeNavas-Walt,et al.  Income and Poverty in the United States: 2013 , 2014 .

[2]  Stefan de Weerd,et al.  Psychometric Properties of the Dutch Version of the Self-Sufficiency Matrix (SSM-D) , 2013, Community Mental Health Journal.

[3]  Kristopher J Preacher,et al.  The development and validation of the protective factors survey: a self-report measure of protective factors against child maltreatment. , 2010, Child abuse & neglect.

[4]  K. Dodge,et al.  Creating Community Responsibility for Child Protection: Possibilities and Challenges , 2009, The Future of children.

[5]  J. Shonkoff,et al.  Building a new biodevelopmental framework to guide the future of early childhood policy. , 2010, Child development.

[6]  H. Sandstrom,et al.  The Negative Effects of Instability on Child Development , 2013 .

[7]  J. Brooks-Gunn,et al.  Two-Generation Programs in the Twenty-First Century , 2015, The Future of children.

[8]  Janet S. Walker.  How , and Why , Does Wraparound Work : A Theory of Change , 2022 .

[9]  Elizabeth Fernandez.  Effective interventions to promote child and family wellness: a study of outcomes of intervention through Children's Family Centres , 2004 .

[10]  R. Homel,et al.  A meta-analysis of the effects of early developmental prevention programs in at-risk populations on non-health outcomes in adolescence , 2010 .

[11]  G. Benedetti.  Innovations in the Field of Child Abuse and Neglect Prevention: A Review of the Literature. , 2012 .

[12]  Elizabeth Fernandez.  Supporting children and responding to their families: Capturing the evidence on family support , 2007 .

[13]  W. Parker,et al.  Accountability, Cost-Effectiveness, and Program Performance: Progress Since 1998 , 2013 .

[14]  Kevin A Hallgren,et al.  Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. , 2012, Tutorials in quantitative methods for psychology.