Programming and training rate-independent chemical reaction networks

Embedding computation in biochemical environments incompatible with traditional electronics is expected to have wide-ranging impact in synthetic biology, medicine, nanofabrication and other fields. Natural biochemical systems are typically modeled by chemical reaction networks (CRNs), and CRNs can be used as a specification language for synthetic chemical computation. In this paper, we identify a class of CRNs called non-competitive (NC) whose equilibria are absolutely robust to reaction rates and kinetic rate law, because their behavior is captured solely by their stoichiometric structure. Unlike prior work on rate-independent CRNs, checking non-competition and using it as a design criterion is easy and promises robust output. We also present a technique to program NC-CRNs using well-founded deep learning methods, showing a translation procedure from rectified linear unit (ReLU) neural networks to NC-CRNs. In the case of binary weight ReLU networks, our translation procedure is surprisingly tight in the sense that a single bimolecular reaction corresponds to a single ReLU node and vice versa. This compactness argues that neural networks may be a fitting paradigm for programming rate-independent chemical computation. As proof of principle, we demonstrate our scheme with numerical simulations of CRNs translated from neural networks trained on traditional machine learning datasets (IRIS and MNIST), as well as tasks better aligned with potential biological applications including virus detection and spatial pattern formation.

[1]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[2]  E. Anderson The Species Problem in Iris , 1936 .

[3]  C. A. Petri Communication with automata , 1966 .

[4]  Richard M. Karp,et al.  Parallel Program Schemata , 1969, J. Comput. Syst. Sci..

[5]  A Hjelmfelt,et al.  Chemical implementation of neural networks and Turing machines. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[6]  H V Westerhoff,et al.  UvA-DARE ( Digital Academic Repository ) Signal transduction in bacteria : phospho-neural network ( s ) in Escherichia coli ? , 2003 .

[7]  D. Bray Protein molecules as computational elements in living cells , 1995, Nature.

[8]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[9]  Irving R. Epstein,et al.  An Introduction to Nonlinear Chemical Dynamics: Oscillations, Waves, Patterns, and Chaos , 1998 .

[10]  S. Ovchinnikov Max-Min Representation of Piecewise Linear Functions , 2000, math/0009026.

[11]  Nicolas E. Buchler,et al.  On schemes of combinatorial transcription logic , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Michael J. Fischer,et al.  Computation in networks of passively mobile finite-state sensors , 2004, PODC '04.

[13]  B. L. Clarke Stoichiometric network analysis , 2008, Cell Biophysics.

[14]  Georg Seelig,et al.  Time-Complexity of Multilayered DNA Strand Displacement Circuits , 2009, DNA.

[15]  G. Seelig,et al.  DNA as a universal substrate for chemical kinetics , 2010, Proceedings of the National Academy of Sciences.

[16]  Marc D. Riedel,et al.  Rate-Independent Constructs for Chemical Computation , 2011, Pacific Symposium on Biocomputing.

[17]  Jehoshua Bruck,et al.  Neural network computation with DNA strand displacement cascades , 2011, Nature.

[18]  Ho-Lin Chen,et al.  Deterministic function computation with chemical reaction networks , 2012, Natural Computing.

[19]  Luca Cardelli,et al.  Programmable chemical controllers made from DNA. , 2013, Nature nanotechnology.

[20]  Teruo Fujii,et al.  Predator-prey molecular ecosystems. , 2013, ACS nano.

[21]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[22]  Ho-Lin Chen,et al.  Rate-independent computation in continuous chemical reaction networks , 2014, ITCS.

[23]  Jie-Hong Roland Jiang,et al.  Reconfigurable neuromorphic computation in biochemical systems , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  Yoshua Bengio,et al.  BinaryConnect: Training Deep Neural Networks with binary weights during propagations , 2015, NIPS.

[25]  Christof Teuscher,et al.  Feedforward Chemical Neural Network : An In Silico Chemical System , 2018 .

[26]  Erik Winfree,et al.  Enzyme-free nucleic acid dynamical systems , 2017, Science.

[27]  Georg Seelig,et al.  A molecular multi-gene classifier for disease diagnostics , 2018, Nature Chemistry.

[28]  David Soloveichik,et al.  Composable Rate-Independent Computation in Continuous Chemical Reaction Networks , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[29]  Lulu Qian,et al.  Scaling up molecular pattern recognition with DNA-based winner-take-all neural networks , 2018, Nature.

[30]  Martin Feinberg,et al.  Foundations of Chemical Reaction Network Theory , 2019, Applied Mathematical Sciences.

[31]  D. Soloveichik,et al.  CRNs Exposed: Systematic Exploration of Chemical Reaction Networks , 2019, ArXiv.

[32]  Yolanda Schaerli,et al.  Using Synthetic Biology to Engineer Spatial Patterns , 2019, Advanced biosystems.

[33]  Sylvain Soliman,et al.  Graphical Conditions for Rate Independence in Chemical Reaction Networks , 2020, CMSB.

[34]  Sarfraz Khurshid,et al.  Deep Molecular Programming: A Natural Implementation of Binary-Weight ReLU Neural Networks , 2020, ICML.

[35]  David F. Anderson,et al.  On reaction network implementations of neural networks , 2020, Journal of the Royal Society Interface.