Prediction-Corrected Visual Predictive Checks for Diagnosing Nonlinear Mixed-Effects Models

Informative diagnostic tools are vital to the development of useful mixed-effects models. The Visual Predictive Check (VPC) is a popular tool for evaluating the performance of population PK and PKPD models. Ideally, a VPC will diagnose both the fixed and random effects in a mixed-effects model. In many cases, this can be done by comparing different percentiles of the observed data to percentiles of simulated data, generally grouped together within bins of an independent variable. However, the diagnostic value of a VPC can be hampered by binning across a large variability in dose and/or influential covariates. VPCs can also be misleading if applied to data following adaptive designs such as dose adjustments. The prediction-corrected VPC (pcVPC) offers a solution to these problems while retaining the visual interpretation of the traditional VPC. In a pcVPC, the variability coming from binning across independent variables is removed by normalizing the observed and simulated dependent variable based on the typical population prediction for the median independent variable in the bin. The principal benefit with the pcVPC has been explored by application to both simulated and real examples of PK and PKPD models. The investigated examples demonstrate that pcVPCs have an enhanced ability to diagnose model misspecification especially with respect to random effects models in a range of situations. The pcVPC was in contrast to traditional VPCs shown to be readily applicable to data from studies with a priori and/or a posteriori dose adaptations.

[1]  M O Karlsson,et al.  Pharmacodynamic models for the cardiovascular effects of moxonidine in patients with congestive heart failure. , 2001, British journal of clinical pharmacology.

[2]  Mats O. Karlsson,et al.  Approaches to handling pharmacodynamic baseline responses , 2008, Journal of Pharmacokinetics and Pharmacodynamics.

[3]  France Mentré,et al.  Computing normalised prediction distribution errors to evaluate nonlinear mixed-effect models: The npde add-on package for R , 2008, Comput. Methods Programs Biomed..

[4]  C. Mehta,et al.  The future of drug development: advancing clinical trial design , 2009, Nature Reviews Drug Discovery.

[5]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[6]  E. Niclas Jonsson,et al.  Erratum to "PsN-Toolkit - A collection of computer intensive statistical methods for non-linear mixed effect modeling using NONMEM" [Comput. Methods Prog. Biomedicine 79 (2005) 241-257] , 2005, Comput. Methods Programs Biomed..

[7]  Emmanuelle Comets,et al.  Model evaluation in nonlinear mixed effect models, with applications to pharmacokinetics , 2010 .

[8]  M O Karlsson,et al.  Diagnosing Model Diagnostics , 2007, Clinical pharmacology and therapeutics.

[9]  Adrian Dunne,et al.  Analysis of Nonrandomly Censored Ordered Categorical Longitudinal Data from Analgesic Trials , 1997 .

[10]  E N Jonsson,et al.  Xpose--an S-PLUS based population pharmacokinetic/pharmacodynamic model building aid for NONMEM. , 1999, Computer methods and programs in biomedicine.

[11]  MO Karlsson,et al.  Modeling and Simulation of the Time Course of Asenapine Exposure Response and Dropout Patterns in Acute Schizophrenia , 2009, Clinical pharmacology and therapeutics.

[12]  Derek J. Pike,et al.  Empirical Model‐building and Response Surfaces. , 1988 .

[13]  Nicholas H. G. Holford,et al.  The Visual Predictive Check Superiority to Standard Diagnostic (Rorschach) Plots , 2005 .

[14]  E. Niclas Jonsson,et al.  Perl-speaks-NONMEM (PsN) - a Perl module for NONMEM related programming , 2004, Comput. Methods Programs Biomed..

[15]  Mats O. Karlsson,et al.  Handling Data Below the Limit of Quantification in Mixed Effect Models , 2009, The AAPS Journal.

[16]  Marc Lavielle,et al.  Maximum likelihood estimation in nonlinear mixed effects models , 2005, Comput. Stat. Data Anal..

[17]  E. Niclas Jonsson,et al.  PsN-Toolkit - A collection of computer intensive statistical methods for non-linear mixed effect modeling using NONMEM , 2005, Comput. Methods Programs Biomed..

[18]  Meindert Danhof,et al.  Extensions to the Visual Predictive Check to facilitate model performance evaluation , 2008, Journal of Pharmacokinetics and Pharmacodynamics.

[19]  Lena E Friberg,et al.  Population Pharmacokinetics of Tacrolimus in Pediatric Hematopoietic Stem Cell Transplant Recipients: New Initial Dosage Suggestions and a Model-Based Dosage Adjustment Tool , 2009, Therapeutic drug monitoring.