Application of Bayesian Optimization for Pharmaceutical Product Development

PurposeBayesian optimization has been studied in many fields as a technique for global optimization of black-box functions. We applied these techniques for optimizing the formulation and manufacturing methods of pharmaceutical products to eliminate unnecessary experiments and accelerate method development tasks.MethodA simulation dataset was generated by the data augmentation from a design of experiment (DoE) which was executed to optimize the formulation and process parameters of orally disintegrating tablets. We defined a composite score for integrating multiple objective functions, physical properties of tablets, to meet the pharmaceutical criteria simultaneously. Performance measurements were used to compare the influence of the selection of initial training sets, by controlling data size and variation, acquisition functions, and schedules of hyperparameter tuning. Additionally, we investigated performance improvements obtained using Bayesian optimization techniques as opposed to random search strategy.ResultsBayesian optimization efficiently reduces the number of experiments to obtain the optimal formulation and process parameters from about 25 experiments with DoE to 10 experiments. Repeated hyperparameter tuning during the Bayesian optimization process stabilizes variations in performance among different optimization conditions, thus improving average performance.ConclusionWe demonstrated the elimination of unnecessary experiments using Bayesian optimization. Simulations of different conditions depicted their dependencies, which will be useful in many real-world applications. Bayesian optimization is expected to reduce the reliance on individual skills and experiences, increasing the efficiency and efficacy of optimization tasks, expediting formulation and manufacturing research in pharmaceutical development.

[1]  Venkat Venkatasubramanian,et al.  Neural Network to Understand Process Capability and Process Intermediates Acceptance Criteria in Monoclonal Antibody Production Process , 2017, Journal of Pharmaceutical Innovation.

[2]  Rémi Bardenet,et al.  Monte Carlo Methods , 2013, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[3]  Peter York,et al.  The improved compaction properties of mannitol after a moisture-induced polymorphic transition. , 2003, International journal of pharmaceutics.

[4]  Tsutomu Harada,et al.  A new method for disintegration studies of rapid disintegrating tablet. , 2004, Chemical & pharmaceutical bulletin.

[5]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[6]  Marianthi G. Ierapetritou,et al.  Feasibility analysis of black-box processes using an adaptive sampling Kriging-based method , 2012, Comput. Chem. Eng..

[7]  Peter Auer,et al.  Using Confidence Bounds for Exploitation-Exploration Trade-offs , 2003, J. Mach. Learn. Res..

[8]  G. Box,et al.  On the Experimental Attainment of Optimum Conditions , 1951 .

[9]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[10]  Le Song,et al.  A la Carte - Learning Fast Kernels , 2014, AISTATS.

[11]  Marianthi G. Ierapetritou,et al.  Feasibility and flexibility analysis of black-box processes Part 1: Surrogate-based feasibility analysis , 2015 .

[12]  Harold J. Kushner,et al.  A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise , 1964 .

[13]  M. Ierapetritou,et al.  A novel feasibility analysis method for black‐box processes using a radial basis function adaptive sampling approach , 2017 .

[14]  Matthew G. Heasley,et al.  Determination of the tensile strength of elongated tablets , 2013 .

[15]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[16]  Stefan Fritsch,et al.  neuralnet: Training of Neural Networks , 2010, R J..

[17]  M. Khan,et al.  Quality by design: impact of formulation variables and their interactions on quality attributes of a lyophilized monoclonal antibody. , 2012, International journal of pharmaceutics.

[18]  Adrian Barbu Monte Carlo Methods , 2019 .

[19]  Peter York,et al.  Moisture induced polymorphic transition of mannitol and its morphological transformation. , 2002, International journal of pharmaceutics.

[20]  W. Pan,et al.  Formulation Optimization Technique Based on Artificial Neural Network in Salbutamol Sulfate Osmotic Pump Tablets , 2000, Drug development and industrial pharmacy.

[21]  Hiroaki Arai,et al.  Bootstrap re-sampling technique to evaluate the optimal formulation of theophylline tablets predicted by non-linear response surface method incorporating multivariate spline interpolation. , 2007, Chemical & pharmaceutical bulletin.

[22]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[23]  Lihong Li,et al.  An Empirical Evaluation of Thompson Sampling , 2011, NIPS.

[24]  Kozo Takayama,et al.  Neural network based optimization of drug formulations. , 2003, Advanced drug delivery reviews.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Boris Vrdoljak,et al.  Statistical hierarchical clustering algorithm for outlier detection in evolving data streams , 2020, Mach. Learn..

[27]  Syusuke Sano,et al.  Preparation and evaluation of swelling induced-orally disintegrating tablets by microwave irradiation. , 2011, International journal of pharmaceutics.

[28]  Tsutomu Harada,et al.  Evaluation of the disintegration properties of commercial famotidine 20 mg orally disintegrating tablets using a simple new test and human sensory test. , 2006, Chemical & pharmaceutical bulletin.

[29]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[30]  Syusuke Sano,et al.  Design and evaluation of microwave-treated orally disintegrating tablets containing polymeric disintegrant and mannitol. , 2013, International journal of pharmaceutics.

[31]  Koji Tsuda,et al.  COMBO: An efficient Bayesian optimization library for materials science , 2016 .