Expediting Clinical and Translational Research via Bayesian Instrument Development

Developing valid and reliable instruments is crucial, but costly and time-consuming in health care research and evaluation. The Food and Drug Administration (FDA) and the National Institutes of Health (NIH) have set up guidelines for developing patient-reported outcome (PRO) instruments. However, the guidelines are not applicable to cases of small sample sizes. Instead of using an exact estimation procedure to examine psychometric properties, the Bayesian Instrument Development (BID) method integrates expert data and participant data into a single seamless analysis. Using a novel set of priors, simulated data were used to compare BID to classical instrument development procedures and test the stability of BID. To display BID to non-statisticians, a graphical user interface (GUI) based on R and WINBUGS is developed and demonstrated with data on a small sample of heart failure patients. Costs were saved by eliminating the need for unnecessary continuation of data collection for larger samples as required by the classical instrument development approach.

[1]  Sik-Yum Lee,et al.  Structural equation modelling: A Bayesian approach. , 2007 .

[2]  Patrick J Antonelli,et al.  A log‐normal distribution model of the effect of bacteria and ear fenestration on hearing loss: a Bayesian approach , 2004, Statistics in medicine.

[3]  R. F.,et al.  Mathematical Statistics , 1944, Nature.

[4]  J. Christopher Westland,et al.  Lower bounds on sample size in structural equation modeling , 2010, Electron. Commer. Res. Appl..

[5]  Sik-Yum Lee,et al.  Joint Bayesian Analysis of Factor Scores and Structural Parameters in the Factor Analysis Model , 2000 .

[6]  G. Murray,et al.  Development of the QoL.BD: a disorder-specific scale to assess quality of life in bipolar disorder. , 2010, Bipolar disorders.

[7]  Kathryn Chaloner,et al.  A Bayesian approach to the estimation of variance components for the unbalanced one-way random model , 1987 .

[8]  P. Friedmann,et al.  The index of tobacco treatment quality: development of a tool to assess evidence-based treatment in a national sample of drug treatment facilities , 2013, Substance Abuse Treatment, Prevention, and Policy.

[9]  Bradley Efron,et al.  The Future of Indirect Evidence. , 2010, Statistical science : a review journal of the Institute of Mathematical Statistics.

[10]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[11]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[12]  Cheryl Tatano Beck,et al.  The content validity index: are you sure you know what's being reported? Critique and recommendations. , 2006, Research in nursing & health.

[13]  Cheryl Tatano Beck,et al.  Item Response Theory in Affective Instrument Development: An Illustration , 2001, Journal of Nursing Measurement.

[14]  L. Price,et al.  Integrated analysis of content and construct validity of psychometric instruments , 2013 .

[15]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[16]  William J. Browne,et al.  Bayesian and likelihood-based methods in multilevel modeling 1 A comparison of Bayesian and likelihood-based methods for fitting multilevel models , 2006 .

[17]  Sik-Yum Lee.  A bayesian approach to confirmatory factor analysis , 1981 .

[18]  J. Christopher Westland,et al.  Erratum to "Lower bounds on sample size in structural equation modeling" [Electronic Commerce Research and Applications 9 (6) (2010) 476-487] , 2012, Electron. Commer. Res. Appl..

[19]  A. O'Hagan,et al.  Statistical Methods for Eliciting Probability Distributions , 2005 .

[20]  Snigdhansu Chatterjee,et al.  Structural Equation Modeling, A Bayesian Approach , 2008, Technometrics.

[21]  J. Speight,et al.  FDA guidance on patient reported outcomes , 2010, BMJ : British Medical Journal.

[22]  Nan M Laird,et al.  fgui: A Method for Automatically Creating Graphical User Interfaces for Command-Line R Packages. , 2009, Journal of statistical software.

[23]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[24]  Yves Rosseel,et al.  lavaan: An R Package for Structural Equation Modeling , 2012 .

[25]  B. Gajewski,et al.  Application of Bayesian Methodology to Measure Equivalence Between Two Rating Scales , 2012, Nursing research.

[26]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[27]  Victoria Savalei,et al.  lavaan: Latent variable analysis , 2014 .

[28]  K. Richter,et al.  Substance Abuse Treatment, Prevention, and Policy , 2006 .

[29]  Xin-Yuan Song,et al.  Evaluation of the Bayesian and Maximum Likelihood Approaches in Analyzing Structural Equation Models with Small Sample Sizes , 2004, Multivariate behavioral research.

[30]  Byron J Gajewski,et al.  Inter‐rater reliability of pressure ulcer staging: ordinal probit Bayesian hierarchical model that allows for uncertain rater response , 2007, Statistics in medicine.

[31]  Geert Molenberghs,et al.  A Unified Approach to Multi‐item Reliability , 2010, Biometrics.

[32]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[33]  F. Samaniego,et al.  Toward a Reconciliation of the Bayesian and Frequentist Approaches to Point Estimation , 1994 .

[34]  Samuel B. Green,et al.  Commentary on Coefficient Alpha: A Cautionary Tale , 2009 .

[35]  L. Price,et al.  Assessing Content Validity Through Correlation and Relevance Tools A Bayesian Randomized Equivalence Experiment , 2012 .

[36]  Byron J. Gajewski,et al.  Predicting Hearing Threshold in Nonresponsive Subjects Using a Log-Normal Bayesian Linear Model in the Presence of Left-Censored Covariates , 2009 .

[37]  Daniel J Buysse,et al.  The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. , 2010, Journal of clinical epidemiology.