Cross-national and multi-professional inter-rater reliability of the Housing Enabler

In order to render reliable assessment of housing accessibility in a cross-national context possible, the objective of this study was to investigate multi-professional, cross-national inter-rater reliability of the ENABLE-AGE project-specific version of the Housing Enabler instrument. The data collection was performed with elderly persons in ordinary housing in five European countries. After participation in rater training courses, 26 raters representing different nationalities and professions performed data collection in independent pairs of raters, n=64. Inter-rater reliability was calculated by means of percentage agreement as well as Cohen's kappa. The results demonstrated moderate to good overall inter-rater reliability of the project-specific version of the Housing Enabler instrument. The mean agreement for the personal component part of the instrument was 91%. For 13 of the 15 items in this part kappa values could be defined, , indicating moderate agreement. In the environmental component part the mean agreement for all 188 items was 85%, while , indicating moderate agreement. Given the complexity of the instrument and the number of different professions and countries involved, we consider the Housing Enabler as useful for cross-national research targeting housing accessibility, even if the agreement levels reached were moderate. However, the moderate agreement levels pinpoint the importance of rater training.

[1]  A. Feinstein,et al.  High agreement but low kappa: I. The problems of two paradoxes. , 1990, Journal of clinical epidemiology.

[2]  Dimitris Michailakis,et al.  Standard Rules on the Equalization of Opportunities for Persons with Disabilities , 1995, Human Rights and Disabled Persons.

[3]  H. Illing.  ENVIRONMENT AND AGING , 1958, Journal of the American Geriatrics Society.

[4]  L. Gitlin,et al.  Conducting research on home environments: lessons learned and new directions. , 2003, The Gerontologist.

[5]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[6]  ADL dependence in the elderly: The influence of functional limitations and physical environmental demand. , 1998 .

[7]  A. Schlögl,et al.  Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders , 2004, Journal of sleep research.

[8]  Jan Lanke,et al.  ADL dependence in the elderly population living in the community: the influence of functional limitations and physical environmental demand , 1998 .

[9]  J. Etter,et al.  Cross-cultural adaptation of a psychometric instrument: two methods compared. , 1999, Journal of clinical epidemiology.

[10]  L Punnett,et al.  Evaluation of interrater reliability for posture observations in a field study. , 1999, Applied ergonomics.

[11]  S. Iwarsson,et al.  The ENABLE-AGE Project: Multi-dimensional methodology for European housing research , 2005 .

[12]  On Scaling Methodology and Environmental Influences in Disability Assessments: The Cumulative Structure of Personal and Instrumental ADL among Older Adults in a Swedish Rural District , 1997 .

[13]  J J Bartko,et al.  ON THE METHODS AND THEORY OF RELIABILITY , 1976, The Journal of nervous and mental disease.

[14]  Å. Kilbom,et al.  Assessment of physical exposure in relation to , 1994 .

[15]  N. Sartorius,et al.  Translation of Health Status Instruments , 1994 .

[16]  Susanne Iwarsson,et al.  The Housing Enabler. An Instrument for Assessing and Analysing Accessibility Problems in Housing. , 2001 .

[17]  Jon Christophersen,et al.  Universal design : 17 ways of thinking and teaching , 2002 .

[18]  M. Powell Lawton,et al.  Ecology and the aging process. , 1973 .

[19]  P. Prescott,et al.  Issues in the Use of Kappa to Estimate Reliability , 1986, Medical care.

[20]  E. Steinfeld,et al.  Theory as a Basis for Research on Enabling Environments , 1999 .

[21]  Susanne Iwarsson,et al.  Challenges of cross-national housing research with older persons: lessons from the ENABLE-AGE project , 2004, European journal of ageing.

[22]  S. Iwarsson.  Assessing the Fit Between Older People and Their Physical Home Environments: An Occupational Therapy Research Perspective , 2003, Annual Review of Gerontology and Geriatrics.

[23]  C. Bombardier,et al.  Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. , 1993, Journal of clinical epidemiology.

[24]  M P Lawton,et al.  The ecology of social relationships in housing for the elderly. , 1968, The Gerontologist.

[25]  Susanne Iwarsson,et al.  Accessibility and usability in housing: construct validity and implications for research and practice , 2003, Disability and rehabilitation.

[26]  Å. Kilbom,et al.  Assessment of physical exposure in relation to work-related musculoskeletal disorders--what information can be obtained from systematic observations? , 1994, Scandinavian journal of work, environment & health.

[27]  Silke Schmidt,et al.  Current issues in cross-cultural quality of life instrument development. , 2003, Archives of physical medicine and rehabilitation.

[28]  Edward Steinfeld,et al.  Enabling environments : measuring the impact of environment on disability and rehabiltation , 1999 .

[29]  Susanne Iwarsson,et al.  Development of a Novel Instrument for Occupational Therapy of Assessment of the Physical Environment in the Home—A Methodologic Study on “The Enabler” , 1996 .

[30]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[31]  W. Kuyken,et al.  Quality of Life Assessment: International Perspectives , 1994, Springer Berlin Heidelberg.

[32]  S. Iwarsson,et al.  Accessibility, usability and universal design—positioning and definition of concepts describing person-environment relationships , 2003, Disability and rehabilitation.

[33]  Susanne Iwarsson,et al.  Housing Enabler 1.0: A Tool for Housing Accessibility Analysis. Software for PC. , 2001 .