Reliability and validity in a nutshell.

AIMS To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. BACKGROUND There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. DESIGN To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. RESULTS The concepts of reliability, validity and utility are explored and explained. CONCLUSIONS Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. RELEVANCE TO CLINICAL PRACTICE To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

[1]  K. Seers.  Qualitative data analysis , 2011, Evidence Based Nursing.

[2]  T. Mills,et al.  Measuring Health: A Guide to Rating Scales and Questionnaires , 2006 .

[3]  J. Morse.  Qualitative data analysis (2nd ed): Mathew B. Miles and A. Michael Huberman. Thousand Oaks, CA: Sage Publications, 1994. Price: $65.00 hardback, $32.00 paperback. 238 pp , 1996 .

[4]  Laura A. Pendergrass.  Psychological Testing and Assessment: An Introduction to Tests and Measurement (3rd ed.). , 1997 .

[5]  J. Sim,et al.  Measurement validity in physical therapy research. , 1993, Physical therapy.

[6]  I. Deary,et al.  Are personality trait items reliably more or less ‘difficult’? Mokken scaling of the NEO-FFI , 2007 .

[7]  H. DeVon,et al.  A psychometric toolbox for testing validity and reliability. , 2007, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[8]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[9]  Elizabeth Domholdt,et al.  Physical Therapy Research: Principles and Applications , 1993 .

[10]  P. Bordnick,et al.  Measuring Health: A Guide to Rating Scales and Questionnaires (2nd ed.). , 1997 .

[11]  Roger Watson,et al.  Use of factor analysis in Journal of Advanced Nursing: literature review. , 2006, Journal of advanced nursing.

[12]  Denise Polit-O'Hara,et al.  Nursing Research: Principles and Methods , 1978 .

[13]  P. Brink.  Issues of Reliability and Validity , 1991 .

[14]  I. Deary,et al.  A hierarchy of distress: Mokken scaling of the GHQ-30 , 2008, Psychological Medicine.

[15]  C. Seaman.  Research Methods: Principles, Practice, and Theory for Nursing , 1987 .

[16]  R. Gelber.  MEASURING DISEASE: A REVIEW OF DISEASE‐SPECIFIC QUALITY OF LIFE MEASUREMENTS SCALES. , 1996 .

[17]  O. Payton.  Research, the validation of clinical practice , 1979 .

[18]  M. Lynn.  Determination and quantification of content validity. , 1986, Nursing research.

[19]  Roger Watson,et al.  A hierarchy of items within Eysenck’s EPI , 2008 .

[20]  Duncan Cramer,et al.  Quantitative data analysis for social scientists , 1990 .

[21]  Arthur D. Dempsey,et al.  Nursing Research With Basic Statistical Applications , 1991 .

[22]  Mark S. Litwin,et al.  How to Measure Survey Reliability and Validity , 1995 .

[23]  I. Deary,et al.  Feeding difficulty in elderly patients with dementia: confirmatory factor analysis. , 1997, International journal of nursing studies.

[24]  S. Messick.  The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[25]  W. M. Mathews,et al.  How Do Novice Educational Researchers Find Jobs?1 , 1974 .