Optimization of Substrate Feed Flow Rate for Fed-Batch Yeast Fermentation Process

This paper presents Q-Learning (QL) algorithm based on optimization method to determine optimal glucose feed flow rate profile for the yeast fermentation process. The optimal profile is able to maximize the yeast concentration at the end of the process, meanwhile to minimize the formation of ethanol during the process. The proposed approach is tested under four case studies, which are different in initial yeast and glucose concentration. The results show that the proposed approach is able to control the process in a satisfactory way.

[1]  Ioannis P. Vlahavas,et al.  Multi-agent Reinforcement Learning Using Strategies and Voting , 2007, 19th IEEE International Conference on Tools with Artificial Intelligence(ICTAI 2007).

[2]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[3]  Hisbullah,et al.  Design of a Fuzzy Logic Controller for Regulating Substrate Feed to Fed-Batch Fermentation , 2003 .

[4]  Mustafa Türker,et al.  On-line evolutionary optimization of an industrial fed-batch yeast fermentation process. , 2009, ISA transactions.

[5]  Cihan Karakuzu,et al.  Modelling, on-line state estimation and fuzzy control of production scale fed-batch baker's yeast fermentation , 2006 .

[6]  Uğur Yüzgeç,et al.  Performance comparison of differential evolution techniques on optimization of feeding profile for an industrial scale baker's yeast fermentation process. , 2010, ISA transactions.

[7]  Y. Hoshino,et al.  A proposal of reinforcement learning system to use knowledge effectively , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[8]  Min Guo,et al.  Reinforcement Learning Neural Network to the Problem of Autonomous Mobile Robot Obstacle Avoidance , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[9]  Sing Kiong Nguang,et al.  Modelling and optimization of fed-batch fermentation processes using dynamic neural networks and genetic algorithms , 2004 .

[10]  Mustafa Türker,et al.  Optimal quality control of baker's yeast drying in large scale batch fluidized bed , 2009 .

[11]  Gary G Yen,et al.  Reinforcement learning algorithms for robotic navigation in dynamic environments , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[12]  Aris Gkoulalas-Divanis,et al.  A Hybrid Approach to Frequent Itemset Hiding , 2007 .

[13]  Fernando Tadeo,et al.  Model-free control based on reinforcement learning for a wastewater treatment problem , 2011, Appl. Soft Comput..