Infinite-Horizon Optimal Control of Switched Boolean Control Networks With Average Cost: An Efficient Graph-Theoretical Approach

This study investigates the infinite-horizon optimal control (IHOC) problem for switched Boolean control networks with an average cost criterion. A primary challenge of this problem is the prohibitively high computational cost when dealing with large-scale networks. We attempt to develop a more efficient approach from a novel graph-theoretical perspective. First, a weighted directed graph structure called the optimal state transition graph (OSTG) is established, whose edges encode the optimal action for each admissible state transition between states reachable from a given initial state subject to various constraints. Then, we reduce the IHOC problem into a minimum-mean cycle (MMC) problem in the OSTG. Finally, we develop an algorithm that can quickly find a particular MMC by resorting to Karp’s algorithm in the graph theory and construct an optimal switching control law based on state feedback. The time complexity analysis shows that our algorithm, albeit still running in exponential time, can outperform all the existing methods in terms of time efficiency. A 16-state-3-input signaling network in leukemia is used as a benchmark to test its effectiveness. Results show that the proposed graph-theoretical approach is much more computationally efficient and can reduce the running time dramatically: it runs hundreds or even thousands of times faster than the existing methods. The Python implementation of the algorithm is available at https://github.com/ShuhuaGao/sbcn_mmc.

[1]  S. Kauffman Metabolic stability and epigenesis in randomly constructed genetic nets. , 1969, Journal of theoretical biology.

[2]  Richard M. Karp,et al.  A characterization of the minimum cycle mean in a digraph , 1978, Discret. Math..

[3]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[4]  J E Bailey,et al.  A mathematical description of regulation of the G1-S transition of the mammalian cell cycle. , 1999, Biotechnology and bioengineering.

[5]  Shuzhi Sam Ge,et al.  Analysis and synthesis of switched linear control systems , 2005, Autom..

[6]  Aniruddha Datta,et al.  Optimal infinite horizon control for probabilistic Boolean networks , 2006, 2006 American Control Conference.

[7]  M. Ng,et al.  Control of Boolean networks: hardness results and algorithms for tree structured networks. , 2007, Journal of theoretical biology.

[8]  Ashish Choudhury,et al.  Control approaches for probabilistic gene regulatory networks - What approaches have been developed for addreassinig the issue of intervention? , 2007, IEEE Signal Processing Magazine.

[9]  Edward R. Dougherty,et al.  Effect of Function Perturbation on the Steady-State Distribution of Genetic Regulatory Networks: Optimal Structural Intervention , 2008, IEEE Transactions on Signal Processing.

[10]  Daizhan Cheng,et al.  Controllability and observability of Boolean control networks , 2009, Autom..

[11]  Daizhan Cheng,et al.  Input-state incidence matrix of Boolean control networks and its applications , 2010, Syst. Control. Lett..

[12]  Daizhan Cheng,et al.  A Linear Representation of Dynamics of Boolean Networks , 2010, IEEE Transactions on Automatic Control.

[13]  Yin Zhao A Floyd-like algorithm for optimization of mix-valued logical control networks , 2011, Proceedings of the 30th Chinese Control Conference.

[14]  Michael Margaliot,et al.  A Maximum Principle for Single-Input Boolean Control Networks , 2011, IEEE Transactions on Automatic Control.

[15]  Xin Liu,et al.  Dynamical and Structural Analysis of a T Cell Survival Network Identifies Novel Candidate Therapeutic Targets for Large Granular Lymphocyte Leukemia , 2011, PLoS Comput. Biol..

[16]  D. Cheng,et al.  Stability and stabilization of Boolean networks , 2011 .

[17]  Daizhan Cheng,et al.  Optimal Control of Logical Control Networks , 2011, IEEE Transactions on Automatic Control.

[18]  Yuzhen Wang,et al.  On reachability and controllability of switched Boolean control networks , 2012, Autom..

[19]  Rui-Sheng Wang,et al.  Boolean modeling in systems biology: an overview of methodology and applications , 2012, Physical biology.

[20]  D. Cheng,et al.  Optimal control of finite-valued networks , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[21]  Fangfei Li,et al.  Minimum energy control and optimal-satisfactory control of Boolean control network , 2013 .

[22]  Michael Margaliot,et al.  Observability of Boolean networks: A graph-theoretic approach , 2013, Autom..

[23]  Michael Margaliot,et al.  Minimum-Time Control of Boolean Networks , 2013, SIAM J. Control. Optim..

[24]  Jitao Sun,et al.  Output controllability and optimal output control of state-dependent switched Boolean control networks , 2014, Autom..

[25]  Zhaoxu Yu,et al.  Optimal control algorithms for switched Boolean network , 2014, J. Frankl. Inst..

[26]  Ettore Fornasini,et al.  Optimal Control of Boolean Control Networks , 2014, IEEE Transactions on Automatic Control.

[27]  Yuzhen Wang,et al.  Controllability Analysis and Control Design for Switched Boolean Networks with State and Input Constraints , 2015, SIAM J. Control. Optim..

[28]  Daizhan Cheng,et al.  Receding Horizon Based Feedback Optimization for Mix-Valued Logical Networks , 2015, IEEE Transactions on Automatic Control.

[29]  Fangfei Li,et al.  Pinning Control Design for the Stabilization of Boolean Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Alan Veliz-Cuba,et al.  Identification of control targets in Boolean molecular network models via computational algebra , 2015, BMC Systems Biology.

[31]  Daizhan Cheng,et al.  Control of Large-Scale Boolean Networks via Network Aggregation , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Yang Liu,et al.  On algorithms for state feedback stabilization of Boolean control networks , 2017, Autom..

[33]  Ross M. McConnell,et al.  A note on finding minimum mean cycle , 2017, Inf. Process. Lett..

[34]  Berthold Göttgens,et al.  Reconstructing blood stem cell regulatory network models from single-cell molecular profiles , 2017 .

[35]  Fangfei Li,et al.  Set stabilization for switched Boolean control networks , 2017, Autom..

[36]  Yong Ding,et al.  Invariant Subset and Set Stability of Boolean Networks Under Arbitrary Switching Signals , 2017, IEEE Transactions on Automatic Control.

[37]  James Lam,et al.  An Improved Criterion for Controllability of Boolean Control Networks , 2017, IEEE Transactions on Automatic Control.

[38]  Jinde Cao,et al.  Stabilization of Boolean Control Networks Under Aperiodic Sampled-Data Control , 2018, SIAM J. Control. Optim..

[39]  Zhihua Zhang,et al.  Finite Horizon Tracking Control of Boolean Control Networks , 2018, IEEE Transactions on Automatic Control.

[40]  Yuqian Guo,et al.  Stabilization of switched boolean control networks with state-dependent constraints , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[41]  Jun‐e Feng,et al.  Stabilizability analysis and switching signals design of switched Boolean networks , 2018, Nonlinear Analysis: Hybrid Systems.

[42]  Tielong Shen,et al.  Optimal control of Boolean control networks with average cost: A policy iteration approach , 2019, Autom..

[43]  Wai-Ki Ching,et al.  Switching-based stabilization of aperiodic sampled-data Boolean control networks with all subsystems unstable , 2019, Frontiers of Information Technology & Electronic Engineering.

[44]  Jianquan Lu,et al.  Pinning Controllers for Activation Output Tracking of Boolean Network Under One-Bit Perturbation , 2019, IEEE Transactions on Cybernetics.

[45]  Bowen Li,et al.  Fast-Time Stability of Temporal Boolean Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[46]  Jinde Cao,et al.  Further Results on the Controllability of Boolean Control Networks , 2019, IEEE Transactions on Automatic Control.

[47]  Tong Heng Lee,et al.  Finite-Horizon Optimal Control of Boolean Control Networks: A Unified Graph-Theoretical Approach , 2019, IEEE Transactions on Neural Networks and Learning Systems.