Optimization of invertase production in a fed-batch bioreactor using simulation based dynamic programming coupled with a neural classifier

Abstract A controller based on neuro-dynamic programming coupled with a fuzzy ARTMAP neural network for a fed-batch bioreactor was developed to produce cloned invertase in Saccharomyces cerevisiae yeast in a fed-batch bioreactor. The objective was to find the optimal glucose feed rate profile needed to achieve the highest fermentation profit in this reactive system where the enzyme expression is repressed at high glucose concentrations. The controller updated in time an optimal control action that incremented the fed-batch bioreactor profitability. The proposed neuro-dynamic programming (NDP) approach, coupled with fuzzy ARTMAP classifier, utilized suboptimal control policies to start the optimization. The fuzzy ARTMAP algorithm was used to build a cost surface in the state space visited by the process, thus minimizing the curse of dimensionality with the associated high computational costs. Bellman's iteration was used to improve the fuzzy ARTMAP approximation of the cost surface before its implementation into the control system. The controller was tested at different fermentation conditions for initial reactor volumes within the range 0.4–0.8 l and a final constant fermentation volume of 1.2 l. Profits were higher than those previously reported in the literature, with continuous and smooth glucose feed rate profiles easy to implement under production conditions. The control system was also tested when the substract concentration changed unexpectedly. The controller global performance was also in this case better than those obtained with the best suboptimal policy and previous methods.

[1]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[2]  J.-P. Chiou,et al.  Estimation of Monod model parameters by hybrid differential evolution , 2001 .

[3]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[4]  Jay H. Lee,et al.  Optimal control of a fed-batch bioreactor using simulation-based approximate dynamic programming , 2005, IEEE Transactions on Control Systems Technology.

[5]  P. B. Coaker,et al.  Applied Dynamic Programming , 1964 .

[6]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[7]  D. Sarkar,et al.  Pareto-optimal solutions for multi-objective optimization of fed-batch bioreactors using nondominated sorting genetic algorithm. , 2005 .

[8]  Alex Arenas,et al.  Neural virtual sensor for the inferential prediction of product quality from process variables , 2002 .

[9]  Gabriela Espinosa,et al.  A Fuzzy ARTMAP-Based Quantitative Structure-Property Relationship (QSPR) for Predicting Physical Properties of Organic Compounds , 2001 .

[10]  Thomas J. Mc Avoy,et al.  Use of Neural Nets For Dynamic Modeling and Control of Chemical Process Systems , 1989, 1989 American Control Conference.

[11]  Jose M. Pinto,et al.  Optimal control of bioreactors: a simultaneous approach for complex systems , 2004 .

[12]  Tania Pencheva,et al.  Mathematical Modelling and Variable Structure Control Systems for Fed-Batch Fermentation of Escherichia coli , 2003 .

[13]  Ilse Smets,et al.  Optimal adaptive control of (bio)chemical reactors: past, present and future , 2004 .

[14]  V. Vassiliadis,et al.  Efficient Optimal Control of Bioprocesses Using Second-Order Information , 2000 .

[15]  Barry Lennox,et al.  Integrated condition monitoring and control of fed-batch fermentation processes , 2004 .

[16]  M E Groep,et al.  Performance modeling and simulation of biochemical process sequences with interacting unit operations. , 2000, Biotechnology and bioengineering.

[17]  H C Lim,et al.  Modeling and optimization of cloned invertase expression in Saccharomyces cerevisiae , 1993, Biotechnology and bioengineering.

[18]  Antonio Delgado,et al.  Dynamic neural networks as a tool for the online optimization of industrial fermentation , 2002 .

[19]  Alessandro Brambilla,et al.  Optimal operation of a separation plant using artificial neural networks , 1998 .

[20]  Debasis Sarkar,et al.  Optimization of fed-batch bioreactors using genetic algorithm: multiple control variables , 2004, Comput. Chem. Eng..

[21]  Mohd Azlan Hussain,et al.  Implementation of an Inverse-Model-Based Control Strategy Using Neural Networks on a Partially Simulated Exothermic Reactor , 2000 .

[22]  H Guterman,et al.  Optimization of feeding profile for a fed-batch bioreactor by an evolutionary algorithm. , 2002, Journal of biotechnology.

[23]  Robert Rallo,et al.  The simulation and interpretation of free turbulence with a cognitive neural system , 2000 .

[24]  Jin-Ho Seo,et al.  Fermentation kinetics of recombinant yeast in batch and fed‐batch cultures , 1992, Biotechnology and bioengineering.

[25]  Sanjeev S. Tambe,et al.  Soft-sensor development for fed-batch bioreactors using support vector regression , 2006 .

[26]  J. D. Stigter,et al.  Optimal parametric sensitivity control for a FED batch reactor , 2001, 2001 European Control Conference (ECC).

[27]  Teresa J. Cutright,et al.  Control of a continuous bioreactor using model predictive control , 2005 .

[28]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[29]  Jayant M. Modak,et al.  Optimization of fed-batch bioreactor using neural network model , 1998 .

[30]  S. Dhir,et al.  Dynamic optimization of hybridoma growth in a fed-batch bioreactor. , 2000, Biotechnology and bioengineering.

[31]  Roberto Guardani,et al.  Neural network based approach for optimization of industrial chemical processes , 2000 .