Dynamic modeling and optimization of sustainable algal production with uncertainty using multivariate Gaussian processes

Abstract Dynamic modeling is an important tool to gain better understanding of complex bioprocesses and to determine optimal operating conditions for process control. Currently, two modeling methodologies have been applied to biosystems: kinetic modeling, which necessitates deep mechanistic knowledge, and artificial neural networks (ANN), which in most cases cannot incorporate process uncertainty. The goal of this study is to introduce an alternative modeling strategy, namely Gaussian processes (GP), which incorporates uncertainty but does not require complicated kinetic information. To test the performance of this strategy, GPs were applied to model microalgae growth and lutein production based on existing experimental datasets and compared against the results of previous ANNs. Furthermore, a dynamic optimization under uncertainty is performed, avoiding over-optimistic optimization outside of the model’s validity. The results show that GPs possess comparable prediction capabilities to ANNs for long-term dynamic bioprocess modeling, while accounting for model uncertainty. This strongly suggests their potential applications in bioprocess systems engineering.

[1]  David J. Fleet,et al.  Gaussian Process Dynamical Models , 2005, NIPS.

[2]  A. Dalai,et al.  Review on Biodiesel Production from Various Feedstocks Using 12-Tungstophosphoric Acid (TPA) as a Solid Acid Catalyst Precursor , 2014 .

[3]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[4]  Harvey Arellano-Garcia,et al.  Optimal Operation Strategy for Biohydrogen Production , 2015 .

[5]  Jo‐Shu Chang,et al.  Effects of nitrogen source availability and bioreactor operating strategies on lutein production with Scenedesmus obliquus FSP-3. , 2015, Bioresource technology.

[6]  M. E. Günay,et al.  Investigation of water gas-shift activity of Pt–MOx–CeO2/Al2O3 (M = K, Ni, Co) using modular artificial neural networks , 2012 .

[7]  D. Himmelblau Accounts of Experiences in the Application of Artificial Neural Networks in Chemical Engineering , 2008 .

[8]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[9]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[10]  Hong-Wei Yen,et al.  The Comparison of Lutein Production by Scenesdesmus sp. in the Autotrophic and the Mixotrophic Cultivation , 2011, Applied biochemistry and biotechnology.

[11]  Agathe Girard,et al.  Dynamic systems identification with Gaussian processes , 2005 .

[12]  K. Hellgardt,et al.  Parameters affecting the growth and hydrogen production of the green alga Chlamydomonas reinhardtii , 2011 .

[13]  Mohd Noriznan Mokhtar,et al.  Comparative Analyses of Response Surface Methodology and Artificial Neural Network on Medium Optimization for Tetraselmis sp. FTC209 Grown under Mixotrophic Condition , 2013, TheScientificWorldJournal.

[14]  Zhihua Xiong,et al.  Modelling and optimal control of fed-batch processes using a novel control affine feedforward neural network , 2004, Neurocomputing.

[15]  Teresa M. Mata,et al.  Microalgae for biodiesel production and other applications: A review , 2010 .

[16]  Vassilios S. Vassiliadis,et al.  Analysis of the cyanobacterial hydrogen photoproduction process via model identification and process simulation , 2015 .

[17]  Amine Bermak,et al.  Gaussian process for nonstationary time series prediction , 2004, Comput. Stat. Data Anal..

[18]  Jo‐Shu Chang,et al.  Phototrophic cultivation of a thermo-tolerant Desmodesmus sp. for lutein production: effects of nitrate concentration, light intensity and fed-batch operation. , 2013, Bioresource technology.

[19]  Nilay Shah,et al.  An efficient model construction strategy to simulate microalgal lutein photo‐production dynamic process , 2017, Biotechnology and bioengineering.

[20]  Mohd Azlan Hussain,et al.  Control of polystyrene batch reactors using neural network based model predictive control (NNMPC): An experimental investigation , 2011 .

[21]  M. Hesham El Naggar,et al.  Application of artificial neural networks for modeling of biohydrogen production , 2013 .

[22]  Yinghua Feng,et al.  Neural network processing of microbial fuel cell signals for the identification of chemicals present in water. , 2013, Journal of environmental management.

[23]  Jie Zhang,et al.  Artificial Intelligence techniques applied as estimator in chemical process systems - A literature survey , 2015, Expert Syst. Appl..

[24]  Uwe D. Hanebeck,et al.  Analytic moment-based Gaussian process filtering , 2009, ICML '09.

[25]  Robert M. Haralick,et al.  Feature normalization and likelihood-based similarity measures for image retrieval , 2001, Pattern Recognit. Lett..

[26]  S. Scott,et al.  Kinetic modelling of growth and storage molecule production in microalgae under mixotrophic and autotrophic conditions. , 2014, Bioresource technology.

[27]  Geoffrey E. Hinton,et al.  Evaluation of Gaussian processes and other methods for non-linear regression , 1997 .

[28]  Wan-Loy Chu,et al.  Biotechnological applications of microalgae , 2012, International e-Journal of Science, Medicine & Education.

[29]  Vassilios S. Vassiliadis,et al.  Bioprocess modelling of biohydrogen production by Rhodopseudomonas palustris: Model development and effects of operating conditions on hydrogen yield and glycerol conversion efficiency , 2015 .

[30]  Artur M. Schweidtmann,et al.  Efficient multiobjective optimization employing Gaussian processes, spectral sampling and a genetic algorithm , 2018, Journal of Global Optimization.

[31]  A. Ariff,et al.  Comparison of the estimation capabilities of response surface methodology and artificial neural network for the optimization of recombinant lipase production by E. coli BL21 , 2012, Journal of Industrial Microbiology & Biotechnology.

[32]  Lars Imsland,et al.  Stochastic Nonlinear Model Predictive Control Using Gaussian Processes , 2018, 2018 European Control Conference (ECC).

[33]  Zheng Sun,et al.  Microalgae as a source of lutein: chemistry, biosynthesis, and carotenogenesis. , 2015, Advances in biochemical engineering/biotechnology.

[34]  Sangeeta Negi,et al.  Use of artificial neural network (ANN) for the development of bioprocess using Pinus roxburghii fallen foliages for the release of polyphenols and reducing sugars. , 2013, Bioresource technology.

[35]  Philip Owende,et al.  Biofuels from microalgae—A review of technologies for production, processing, and extractions of biofuels and co-products , 2010 .

[36]  Carl E. Rasmussen,et al.  PILCO: A Model-Based and Data-Efficient Approach to Policy Search , 2011, ICML.

[37]  Dongda Zhang,et al.  Kinetic Modeling and Process Analysis for Desmodesmus sp. Lutein Photo-Production , 2017 .

[38]  Y. Chisti,et al.  Artificial neural network modeling for predicting the growth of the microalga Karlodinium veneficum , 2016 .

[39]  C. Rasmussen,et al.  Gaussian Process Priors with Uncertain Inputs - Application to Multiple-Step Ahead Time Series Forecasting , 2002, NIPS.

[40]  S. Sundararajan,et al.  Predictive Approaches for Choosing Hyperparameters in Gaussian Processes , 1999, Neural Computation.

[41]  G. Thomas,et al.  Recent Developments in Production and Biotechnological Applications of C-Phycocyanin , 2013, BioMed research international.

[42]  Robin Smith,et al.  Operational optimization of crude oil distillation systems using artificial neural networks , 2013, Comput. Chem. Eng..

[43]  Fabian J Theis,et al.  Lessons Learned from Quantitative Dynamical Modeling in Systems Biology , 2013, PloS one.

[44]  Dongda Zhang,et al.  Dynamic modeling and optimization of cyanobacterial C-phycocyanin production process by artificial neural network , 2016 .

[45]  Vassilios S. Vassiliadis,et al.  Model-based real-time optimisation of a fed-batch cyanobacterial hydrogen production process using economic model predictive control strategy , 2016 .

[46]  Prodromos Daoutidis,et al.  Modeling and Dynamic Optimization of Microalgae Cultivation in Outdoor Open Ponds , 2016 .

[47]  Marc Peter Deisenroth,et al.  Efficient reinforcement learning using Gaussian processes , 2010 .

[48]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[49]  M. Erdem Günay,et al.  Knowledge extraction for water gas shift reaction over noble metal catalysts from publications in the literature between 2002 and 2012 , 2014 .

[50]  A. Otero,et al.  Two-stage cultures for the production of astaxanthin from Haematococcus pluvialis. , 2001, Journal of biotechnology.

[51]  David J. Fleet,et al.  3D People Tracking with Gaussian Process Dynamical Models , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[52]  A. O'Hagan,et al.  Curve Fitting and Optimal Design for Prediction , 1978 .

[53]  Vishnu Pareek,et al.  Artificial neural network modeling of a multiphase photodegradation system , 2002 .