Is less more? A preliminary investigation of the number of response categories in self-reported pain

The purpose of this study was to conduct a preliminary investigation of the number of response options for self-reports of pain interference. Responses to interference items of the 11-category Brief Pain Inventory (BPI) were obtained in a sample of 434 persons from two sites and modeled using the partial credit model. In successive calibrations, response categories were collapsed and new scores were generated. Scores based on two to three categories produced poor results. Four to five categories yielded better results. However, scoring using more than five categories did not appreciably improve the reliability, person separation, or validity of scores. These results suggest that fewer response categories—as few as five or six–may function as well as the 11 response categories that are conventionally used. The results are preliminary since the number of response categories actually presented was not manipulated in the study design. Future research should compare the reliability and validity of scores based on the BPI interference items when items are presented with the conventionally 11-response format, versus presentation with fewer response options.

[1]  C. Cleeland,et al.  [Validation of the Spanish version of the Brief Pain Inventory in patients with oncological pain]. , 2003, Medicina clinica.

[2]  G. Jenkins,et al.  A Monte Carlo study of factors affecting three indices of composite scale reliability. , 1977 .

[3]  L. Weng.  Impact of the Number of Response Categories and Anchor Labels on Coefficient Alpha and Test-Retest Reliability , 2004 .

[4]  Ware J.E.Jr.,et al.  THE MOS 36- ITEM SHORT FORM HEALTH SURVEY (SF- 36) CONCEPTUAL FRAMEWORK AND ITEM SELECTION , 1992 .

[5]  Lei Chang.  A Psychometric Evaluation of 4-Point and 6-Point Likert-Type Scales in Relation to Reliability and Validity , 1994 .

[6]  C. Cleeland,et al.  Validation of the German version of the Brief Pain Inventory. , 1999, Journal of pain and symptom management.

[7]  C. Cleeland,et al.  Validation of the Brief Pain Inventory in a Taiwanese population. , 1999, Journal of pain and symptom management.

[8]  C. Cleeland,et al.  Greek Brief Pain Inventory: Validation and Utility in Cancer Pain , 2000, Oncology.

[9]  L. Radbruch,et al.  Symptoms during cancer pain treatment following WHO-guidelines: a longitudinal follow-up study of symptom prevalence, severity and etiology , 2001, Pain.

[10]  C. Cleeland,et al.  Validity of the Brief Pain Inventory for Use in Documenting the Outcomes of Patients With Noncancer Pain , 2004, The Clinical journal of pain.

[11]  J. Farrar,et al.  Core outcome measures for chronic pain clinical trials: IMMPACT recommendations , 2003, Pain.

[12]  C. Cleeland,et al.  Development of a Cancer Pain Assessment Tool in Korea: A Validation Study of a Korean Version of the Brief Pain Inventory , 2004, Oncology.

[13]  A. Colman,et al.  Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. , 2000, Acta psychologica.

[14]  C. Cleeland,et al.  The Utility and Validity of the Modified Brief Pain Inventory in a Multiple-Dose Postoperative Analgesic Trial , 2004, The Clinical journal of pain.

[15]  M. Stone,et al.  The effect of sample size for estimating Rasch/IRT parameters with dichotomous items. , 2004, Journal of applied measurement.

[16]  C. Cleeland,et al.  Validación española del cuestionario Brief Pain Inventory en pacientes con dolor de causa neoplásica , 2003 .

[17]  E. Dukes,et al.  Validation of a modified version of the Brief Pain Inventory for painful diabetic peripheral neuropathy. , 2005, Journal of vascular nursing : official publication of the Society for Peripheral Vascular Nursing.

[18]  A. W. Bendig.  The reliability of self-ratings as a function of the amount of verbal anchoring and of the number of categories on the scale. , 1953 .

[19]  James O. Ramsay,et al.  The effect of number of categories in rating scales on precision of estimation of scale values , 1973 .

[20]  A. W. Bendig.  Reliability and the number of rating-scale categories. , 1954 .

[21]  S. McMillan,et al.  Validating the brief pain inventory for use with surgical patients with cancer. , 2003, Oncology nursing forum.

[22]  Peter Tyrer,et al.  The Effect of Number of Rating Scale Categories on Levels of Interrater Reliability : A Monte Carlo Investigation , 1985 .

[23]  S. McKelvie,et al.  Graphic rating scales — How many categories? , 1978 .

[24]  R. Lissitz,et al.  Effect of the number of scale points on reliability: A Monte Carlo approach. , 1975 .

[25]  C. Sherbourne,et al.  The MOS 36-Item Short-Form Health Survey (SF-36) , 1992 .

[26]  S. Kaasa,et al.  The Norwegian brief pain inventory questionnaire: translation and validation in cancer pain patients. , 2002, Journal of pain and symptom management.

[27]  K. Raichle,et al.  The reliability and validity of pain interference measures in persons with spinal cord injury. , 2006, The journal of pain : official journal of the American Pain Society.

[28]  M. Jensen,et al.  Validation of the Brief Pain Inventory for chronic nonmalignant pain. , 2004, The journal of pain : official journal of the American Pain Society.

[29]  Meredith Y. Smith,et al.  The validity and utility of the BPI interference measures for evaluating the impact of osteoarthritic pain. , 2006, Journal of pain and symptom management.

[30]  G. Masters.  A rasch model for partial credit scoring , 1982 .

[31]  R. H. Finn.  Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of Ratings , 1972 .

[32]  P. Symonds,et al.  On the Loss of Reliability in Ratings Due to Coarseness of the Scale. , 1924 .

[33]  M. R. Espejo.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2004 .

[34]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[35]  M. Jensen,et al.  The reliability and validity of pain interference measures in persons with cerebral palsy. , 2002, Archives of physical medicine and rehabilitation.

[36]  P. Fayers.  Item Response Theory for Psychologists , 2004, Quality of Life Research.

[37]  Richard M. Smith.  The Distributional Properties of Rasch Item Fit Statistics , 1991 .

[38]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .