Development of a Microsoft Excel tool for one-parameter Rasch model of continuous items: an application to a safety attitude survey

BackgroundMany continuous item responses (CIRs) are encountered in healthcare settings, but no one uses item response theory’s (IRT) probabilistic modeling to present graphical presentations for interpreting CIR results. A computer module that is programmed to deal with CIRs is required.To present a computer module, validate it, and verify its usefulness in dealing with CIR data, and then to apply the model to real healthcare data in order to show how the CIR that can be applied to healthcare settings with an example regarding a safety attitude survey.MethodsUsing Microsoft Excel VBA (Visual Basic for Applications), we designed a computer module that minimizes the residuals and calculates model’s expected scores according to person responses across items. Rasch models based on a Wright map and on KIDMAP were demonstrated to interpret results of the safety attitude survey.ResultsThe author-made CIR module yielded OUTFIT mean square (MNSQ) and person measures equivalent to those yielded by professional Rasch Winsteps software. The probabilistic modeling of the CIR module provides messages that are much more valuable to users and show the CIR advantage over classic test theory.ConclusionsBecause of advances in computer technology, healthcare users who are familiar to MS Excel can easily apply the study CIR module to deal with continuous variables to benefit comparisons of data with a logistic distribution and model fit statistics.

[1]  Isaac I. Bejar An Application of the Continuous Response Level Model to Personality Measurement , 1977 .

[2]  P. Ferrando,et al.  A nonlinear congeneric model for continuous item responses. , 2001, The British journal of mathematical and statistical psychology.

[3]  John M Linacre,et al.  Optimizing rating scale category effectiveness. , 2002, Journal of applied measurement.

[4]  Fumiko Samejima,et al.  Normal ogive model on the continuous response level in the multidimensional latent space , 1974 .

[5]  Wen-Chung Wang,et al.  Online assessment of patients' views on hospital performances using Rasch model's KIDMAP diagram , 2009, BMC health services research.

[6]  H. Swartz,et al.  Diagnosis of nonpsychotic patients in community clinics. , 2000, The American journal of psychiatry.

[7]  F. Samejima Homogeneous case of the continuous response model , 1973 .

[8]  M. R. Espejo Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2004 .

[9]  Jan R. Böhnke,et al.  An evaluation of computerized adaptive testing for general psychological distress: combining GHQ-12 and Affectometer-2 in an item bank for public mental health research , 2016, BMC Medical Research Methodology.

[10]  T. Chien,et al.  Applying Computerized Adaptive Testing to the Negative Acts Questionnaire-Revised: Rasch Analysis of Workplace Bullying , 2014, Journal of medical Internet research.

[11]  J. Alcalay,et al.  Analysis of laboratory data in acne patients treated with isotretinoin: is there really a need to perform routine laboratory tests? , 2001, The Journal of dermatological treatment.

[12]  Heon-Jae Jeong,et al.  A Strategy to Develop Tailored Patient Safety Culture Improvement Programs with Latent Class Analysis Method , 2015 .

[13]  Yvonnick Noel,et al.  A Beta Item Response Model for Continuous Bounded Responses , 2007 .

[14]  H. Müller,et al.  A rasch model for continuous ratings , 1987 .

[15]  Jonathan B. Singer,et al.  Screening for Anxiety and Depression in Community Mental Health: The Beck Anxiety and Depression Inventories , 2008, Community Mental Health Journal.

[16]  Tianyou Wang,et al.  Item Parameter Estimation for a Continuous Response Model Using an EM Algorithm , 1998 .

[17]  G. J. Mellenbergh,et al.  A Unidimensional Latent Trait Model for Continuous Item Responses. , 1994, Multivariate behavioral research.

[18]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[19]  Heon-Jae Jeong,et al.  Item Response Theory-Based Evaluation of Psychometric Properties of the Safety Attitudes Questionnaire— Korean Version (SAQ-K) , 2016 .

[20]  D. D. De Beurs,et al.  Applying Computer Adaptive Testing to Optimize Online Assessment of Suicidal Behavior: A Simulation Study , 2014, Journal of medical Internet research.

[21]  Heon-Jae Jeong,et al.  Development of the Safety Attitudes Questionnaire - Korean Version (SAQ-K) and its Novel Analysis Methods for Safety Managers , 2015 .

[22]  C. P. Hughes,et al.  A New Clinical Scale for the Staging of Dementia , 1982, British Journal of Psychiatry.

[23]  How-Ran Guo,et al.  Bmc Medical Research Methodology Open Access Kidmap, a Web Based System for Gathering Patients' Feedback on Their Doctors , 2009 .

[24]  T. Chien,et al.  Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes , 2016, JMIR medical informatics.

[25]  C. N. Legalos Aversive behavior therapy for chronic stomach pain: A case study , 1977, Pain.

[26]  Galina Velikova,et al.  Rasch fit statistics and sample size considerations for polytomous data , 2008, BMC medical research methodology.

[27]  F. Samejima Estimation of latent ability using a response pattern of graded scores , 1968 .

[28]  D. Andrich A rating formulation for ordered response categories , 1978 .

[29]  Monika Janda,et al.  Estimating Skin Cancer Risk: Evaluating Mobile Computer-Adaptive Testing , 2016, Journal of medical Internet research.

[30]  A. Rush,et al.  Methods to improve diagnostic accuracy in a community mental health setting. , 2000, The American journal of psychiatry.

[31]  Wen-Chung Wang,et al.  Item Parameter Recovery, Standard Error Estimates, and Fit Statistics of the Winsteps Program for the Family of Rasch Models , 2005 .

[32]  M. Bushnell,et al.  Temporal and qualitative properties of cold pain and heat pain: a psychophysical study , 1998, Pain.

[33]  Pa-Chun Wang,et al.  Hospital Safety Culture in Taiwan: A Nationwide Survey Using Chinese Version Safety Attitude Questionnaire , 2010, BMC health services research.

[34]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .