Guidelines to statistical evaluation of data from rating scales and questionnaires.

Questionnaires and rating scales are commonly used to measure qualitative variables, such as feelings, attitudes and many other behavioural and health-related variables. There are different types of instruments ranging from single scales to multidimensional, multi-item questionnaires. The scaling of the responses can vary from the dichotomous alternatives “yes” and “no” to a mark on a line, as in the visual analogue scale (VAS). Numerical labels are commonly used for the recordings. Nevertheless, irrespective of the type of scaling, the item responses indicate only an ordered structure and not a numerical value in a mathematical sense. Such data are often called ordered categorical or ordinal (1–4). Statistical methods for data from rating scales must take account of the rank-invariant propertiesof ordinal data, whichmeans that the methodsmust be unaffected by a relabelling of the scale categories. Hence, statistical methods applicable to data from rating scales differ completely from the traditional methods for quantitative variables, since calculations based on adding or subtracting ordinal data are not appropriate. Sum scores of multi-item assessments, the mean value, standard deviation and calculation of differences for description of change in score do not have an interpretable meaning and must be avoided in the statistical evaluation of data from rating scales and questionnaires (4–6). Traditionally, in applied research, there is a temptation to treat data from rating scales as numerical on an interval level (4, 5). It should be emphasized, however, that data on an interval level are quantitative, which means that such data have the mathematical properties of well-deŽ ned size and equidistance, but the same variable does not have the same ratio when it is measured in different units (1). Hence, qualitative data could never gain the properties required for being treated as interval data. Statistical methods for quantitative data are valid only when data have the mathematical properties of well-deŽ ned size and distance, and conclusions drawn from such analyses are solely interpretable and reliable for quantitative data. However, quantitative data such as blood pressure could be treated as ordinal when categorized as “low”, “normal” and “high”. Such categorization changes the choice of appropriate statistical methods of analysis. GUIDELINES FOR STUDIES INCLUDING RATING SCALES AND/OR QUESTIONNAIRES

[1]  E Svensson,et al.  Construction of a single global scale for multi‐item assessments of the same variable , 2001, Statistics in medicine.

[2]  Elisabeth Svensson,et al.  Comparison of the Quality of Assessments Using Continuous and Discrete Ordinal Rating Scales , 2000 .

[3]  Elisabeth Svensson,et al.  Parallel reliability of the Functional Independence Measure and the Barthel ADL index , 2000, Disability and rehabilitation.

[4]  E Svensson,et al.  Ordinal invariant measures for individual and group changes in ordered categorical data. , 1998, Statistics in medicine.

[5]  E Svensson,et al.  Measures of individual and group changes in ordered categorical data: application to the ADL staircase. , 1997, Scandinavian journal of rehabilitation medicine.

[6]  E. Svensson Analysis of systematic and random differences between paired ordinal categorical data , 1995 .

[7]  A. Venot,et al.  Methodological and statistical problems in the construction of composite measurement scales: a survey of six medical and epidemiological journals. , 1995, Statistics in medicine.

[8]  N. Keiding,et al.  Book Review: Analysis of systematic and random differences between paired ordinal categorical data. Elisabeth Svensson, Almqvist and Wiksell, Göteberg, 1993 , 1995 .

[9]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[10]  J C Grip,et al.  Ordinal scales and foundations of misinference. , 1989, Archives of physical medicine and rehabilitation.

[11]  G. Smith Measuring Health: a Practical Approach , 1988 .

[12]  A. J. Collins,et al.  Introduction To Multivariate Analysis , 1981 .

[13]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[14]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.