The thermodynamic efficiency of computations made in cells across the range of life

Biological organisms must perform computation as they grow, reproduce and evolve. Moreover, ever since Landauer’s bound was proposed, it has been known that all computation has some thermodynamic cost—and that the same computation can be achieved with greater or smaller thermodynamic cost depending on how it is implemented. Accordingly an important issue concerning the evolution of life is assessing the thermodynamic efficiency of the computations performed by organisms. This issue is interesting both from the perspective of how close life has come to maximally efficient computation (presumably under the pressure of natural selection), and from the practical perspective of what efficiencies we might hope that engineered biological computers might achieve, especially in comparison with current computational systems. Here we show that the computational efficiency of translation, defined as free energy expended per amino acid operation, outperforms the best supercomputers by several orders of magnitude, and is only about an order of magnitude worse than the Landauer bound. However, this efficiency depends strongly on the size and architecture of the cell in question. In particular, we show that the useful efficiency of an amino acid operation, defined as the bulk energy per amino acid polymerization, decreases for increasing bacterial size and converges to the polymerization cost of the ribosome. This cost of the largest bacteria does not change in cells as we progress through the major evolutionary shifts to both single- and multicellular eukaryotes. However, the rates of total computation per unit mass are non-monotonic in bacteria with increasing cell size, and also change across different biological architectures, including the shift from unicellular to multicellular eukaryotes. This article is part of the themed issue ‘Reconceptualizing the origins of life’.

[1]  Seth Lloyd,et al.  Information-theoretic approach to the study of control systems , 2001, physics/0104007.

[2]  O. J. E. Maroney The (absence of a) relationship between thermodynamic and logical reversibility , 2004 .

[3]  Mikhail Prokopenko,et al.  Transfer Entropy and Transient Limits of Computation , 2014, Scientific Reports.

[4]  Hubert P. Yockey,et al.  Information theory, evolution, and the origin of life: Index , 2005 .

[5]  E. Lutz,et al.  Experimental verification of Landauer’s principle linking information and thermodynamics , 2012, Nature.

[6]  Andrei Zinovyev,et al.  How much non-coding DNA do eukaryotes require? , 2006, Journal of theoretical biology.

[7]  Zurek,et al.  Algorithmic randomness and physical entropy. , 1989, Physical review. A, General physics.

[8]  James H. Brown,et al.  A General Model for the Origin of Allometric Scaling Laws in Biology , 1997, Science.

[9]  E. Jaynes The Gibbs Paradox , 1992 .

[10]  Renato Baserga,et al.  The biology of cell reproduction , 1985 .

[11]  N. Margolus,et al.  Invertible cellular automata: a review , 1991 .

[12]  H. Hasegawa,et al.  Generalization of the Second Law for a Nonequilibrium Initial State , 2009, 0907.1569.

[13]  James L. Friar,et al.  Genome Sizes and the Benford Distribution , 2012, PloS one.

[14]  T. Ouldridge,et al.  Fundamental Costs in the Production and Destruction of Persistent Polymer Copies. , 2016, Physical review letters.

[15]  Charles H. Bennett,et al.  Notes on Landauer's Principle, Reversible Computation, and Maxwell's Demon , 2002, physics/0210005.

[16]  Tobias von der Haar,et al.  A quantitative estimation of the global translational activity in logarithmically growing yeast cells , 2008, BMC Systems Biology.

[17]  Paul Davies,et al.  How) Did Information Emerge , 2017 .

[18]  T. Goldman,et al.  Ubiquity of Benford's law and emergence of the reciprocal distribution , 2016, 1604.07391.

[19]  G. Crooks Nonequilibrium Measurements of Free Energy Differences for Microscopically Reversible Markovian Systems , 1998 .

[20]  Eric Smith Thermodynamics of natural selection I: Energy flow and the limits on organization. , 2008, Journal of theoretical biology.

[21]  Johan Aberg,et al.  The thermodynamic meaning of negative entropy , 2011, Nature.

[22]  Mikhail Prokopenko,et al.  On Thermodynamic Interpretation of Transfer Entropy , 2013, Entropy.

[23]  Dean J. Driebe,et al.  Generalization of the second law for a transition between nonequilibrium states , 2010 .

[24]  Stephanie Dutkiewicz,et al.  Growth, metabolic partitioning, and the size of microorganisms , 2011, Proceedings of the National Academy of Sciences.

[25]  Joss Bland-Hawthorn,et al.  ON THE SHOULDERS OF GIANTS: PROPERTIES OF THE STELLAR HALO AND THE MILKY WAY MASS DISTRIBUTION , 2014, 1408.1787.

[26]  Massimiliano Esposito,et al.  Second law and Landauer principle far from equilibrium , 2011, 1104.5165.

[27]  M. Feinberg,et al.  Structural Sources of Robustness in Biochemical Reaction Networks , 2010, Science.

[28]  Susanne Still,et al.  The thermodynamics of prediction , 2012, Physical review letters.

[29]  Karoline Wiesner,et al.  Information-theoretic lower bound on energy cost of stochastic computation , 2011, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[30]  Eric J. Chaisson,et al.  Energy rate density as a complexity metric and evolutionary driver , 2011, Complex..

[31]  G C Johnston,et al.  Regulation of cell size in the yeast Saccharomyces cerevisiae , 1979, Journal of bacteriology.

[32]  James H. Brown,et al.  A general model for ontogenetic growth , 2001, Nature.

[33]  O. Judson The energy expansions of evolution , 2017, Nature Ecology &Evolution.

[34]  T. Sagawa,et al.  Thermodynamics of information , 2015, Nature Physics.

[35]  N. Packard,et al.  Transitions from Nonliving to Living Matter , 2004, Science.

[36]  R. Landauer The physical nature of information , 1996 .

[37]  Blake S. Pollard A Second Law for Open Markov Processes , 2016, Open Syst. Inf. Dyn..

[38]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[39]  B. Jørgensen,et al.  Life under extreme energy limitation: a synthesis of laboratory- and field-based investigations. , 2015, FEMS microbiology reviews.

[40]  M. Kleiber Body size and metabolic rate. , 1947, Physiological reviews.

[41]  S. Lloyd Ultimate physical limits to computation , 1999, Nature.

[42]  M. D. MacLaren The Art of Computer Programming. Volume 2: Seminumerical Algorithms (Donald E. Knuth) , 1970 .

[43]  J. Koski,et al.  Experimental realization of a Szilard engine with a single electron , 2014, Proceedings of the National Academy of Sciences.

[44]  L. Szilard On the decrease of entropy in a thermodynamic system by the intervention of intelligent beings. , 1964, Behavioral science.

[45]  B. Jørgensen,et al.  Microbial life under extreme energy limitation , 2013, Nature Reviews Microbiology.

[46]  D. Wolpert,et al.  Drivers of Bacterial Maintenance and Minimal Energy Requirements , 2017, Front. Microbiol..

[47]  Pablo Sartori,et al.  Thermodynamics of Error Correction , 2015, 1504.06407.

[48]  G. Crooks Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[49]  Jessica C. Flack,et al.  LIFE'S INFORMATION HIERARCHY , 2014 .

[50]  David J Schwab,et al.  Energetic costs of cellular computation , 2012, Proceedings of the National Academy of Sciences.

[51]  Andrew F. Rex,et al.  Maxwell's Demon, Entropy, Information, Computing , 1990 .

[52]  Charles H. Bennett Time/Space Trade-Offs for Reversible Computation , 1989, SIAM J. Comput..

[53]  C. Jarzynski Nonequilibrium Equality for Free Energy Differences , 1996, cond-mat/9610209.

[54]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[55]  Kinetic versus energetic discrimination in biological copying. , 2012, Physical review letters.

[56]  P. Bickel,et al.  System wide analyses have underestimated protein abundances and the importance of transcription in mammals , 2012, PeerJ.

[57]  Eric R. Pianka,et al.  On r- and K-Selection , 1970, The American Naturalist.

[58]  H. Bremer Modulation of Chemical Composition and Other Parameters of the Cell by Growth Rate , 1999 .

[59]  E. Fredkin Digital mechanics: an informational process based on reversible universal cellular automata , 1990 .

[60]  D. Krakauer Darwinian demons, evolutionary complexity, and information maximization. , 2011, Chaos.

[61]  Charles H. Bennett,et al.  The thermodynamics of computation—a review , 1982 .

[62]  David C Krakauer,et al.  Challenges for complexity measures: A perspective from social dynamics and collective social computation. , 2011, Chaos.

[63]  James H. Brown,et al.  A general model for the structure and allometry of plant vascular systems , 1999, Nature.

[64]  D. Andrieux,et al.  Nonequilibrium generation of information in copolymerization processes , 2008, Proceedings of the National Academy of Sciences.

[65]  M. B. Plenio,et al.  The physics of forgetting: Landauer's erasure principle and information theory , 2001, quant-ph/0103108.

[66]  W. Martin,et al.  The energetics of genome complexity , 2010, Nature.

[67]  Richard W. Hamming,et al.  Numerical Methods for Scientists and Engineers , 1962 .

[68]  R. Renner,et al.  The minimal work cost of information processing , 2012, Nature Communications.

[69]  Paul Davies,et al.  The Many Faces of State Space Compression , 2017 .

[70]  Hans Rudolf Gnägi,et al.  CORRELATED MORPHOMETRIC AND BIOCHEMICAL STUDIES ON THE LIVER CELL , 1969, The Journal of cell biology.

[71]  Melanie E. Moses,et al.  Shifts in metabolic scaling, production, and efficiency across major evolutionary transitions of life , 2010, Proceedings of the National Academy of Sciences.

[72]  D. Erwin Early metazoan life: divergence, environment and ecology , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[73]  Dmitri Petrov,et al.  Universal features in the energetics of symmetry breaking , 2013, Nature Physics.

[74]  Christian V. Forst,et al.  Defining genes: a computational framework , 2009, Theory in Biosciences.

[75]  R. Macarthur,et al.  The Theory of Island Biogeography , 1969 .

[76]  Rolf Landauer,et al.  Minimal Energy Requirements in Communication , 1996, Science.

[77]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[78]  M. Esposito,et al.  Three faces of the second law. I. Master equation formulation. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[79]  Charles S. Cockell,et al.  An Estimate of the Total DNA in the Biosphere , 2015, PLoS biology.

[80]  Sonja J. Prohaska,et al.  Innovation in gene regulation: the case of chromatin computation. , 2010, Journal of theoretical biology.

[81]  Eric J. Chaisson,et al.  Energy Flows in Low-Entropy Complex Systems , 2015, Entropy.

[82]  O. Maroney Generalizing Landauer's principle. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[83]  A. Knoll,et al.  Eukaryotic organisms in Proterozoic oceans , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[84]  Richard W. Hamming,et al.  Numerical Methods for Scientists and Engineers , 1963 .

[85]  U. Seifert Stochastic thermodynamics, fluctuation theorems and molecular machines , 2012, Reports on progress in physics. Physical Society.

[86]  Lloyd Use of mutual information to decrease entropy: Implications for the second law of thermodynamics. , 1989, Physical review. A, General physics.

[87]  Masahito Ueda,et al.  Fluctuation theorem with information exchange: role of correlations in stochastic thermodynamics. , 2012, Physical review letters.

[88]  Yonggun Jun,et al.  High-precision test of Landauer's principle in a feedback trap. , 2014, Physical review letters.

[89]  Charles H. Bennett,et al.  Logical reversibility of computation , 1973 .

[90]  Mikhail Prokopenko,et al.  Information thermodynamics of near-equilibrium computation. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[91]  Farid Chejne,et al.  A simple derivation of crooks relation , 2013 .

[92]  M. Lynch,et al.  The bioenergetic costs of a gene , 2015, Proceedings of the National Academy of Sciences.

[93]  J. Hopfield Kinetic proofreading: a new mechanism for reducing errors in biosynthetic processes requiring high specificity. , 1974, Proceedings of the National Academy of Sciences of the United States of America.

[94]  David H. Wolpert,et al.  The Free Energy Requirements of Biological Organisms; Implications for Evolution , 2016, Entropy.

[95]  B. Futcher,et al.  A Sampling of the Yeast Proteome , 1999, Molecular and Cellular Biology.

[96]  L. Brillouin,et al.  Science and information theory , 1956 .

[97]  Jeremy L. England,et al.  Statistical physics of self-replication. , 2012, The Journal of chemical physics.

[98]  Eric Lutz,et al.  Comment on "Minimal energy cost for thermodynamic information processing: measurement and information erasure". , 2010, Physical review letters.

[99]  Harold J. Morowitz,et al.  Some order-disorder considerations in living systems , 1955 .

[100]  W. H. Zurek,et al.  Thermodynamic cost of computation, algorithmic complexity and the information metric , 1989, Nature.

[101]  Sara Imari Walker,et al.  From matter to life: Information and causality , 2017 .

[102]  John Doyle,et al.  Evolutionary tradeoffs in cellular composition across diverse bacteria , 2016, The ISME Journal.

[103]  T. Toffoli,et al.  Conservative logic , 2002, Collision-Based Computing.

[104]  Mike Mannion,et al.  Complex systems , 1997, Proceedings International Conference and Workshop on Engineering of Computer-Based Systems.

[105]  Donald Ervin Knuth,et al.  The Art of Computer Programming, Volume II: Seminumerical Algorithms , 1970 .

[106]  Jack A. Tuszynski,et al.  Self-organization and entropy reduction in a living cell , 2013, Biosyst..

[107]  Crispin T. S. Little,et al.  Evidence for early life in Earth’s oldest hydrothermal vent precipitates , 2017, Nature.

[108]  C. Knott Changes in Orangutan Caloric Intake, Energy Balance, and Ketones in Response to Fluctuating Fruit Availability , 1998, International Journal of Primatology.

[109]  Charles H. Bennett,et al.  Dissipation-error tradeoff in proofreading. , 1979, Bio Systems.

[110]  Hubert P. Yockey,et al.  Information theory, evolution and the origin of life , 2005, Inf. Sci..

[111]  Thermodynamics: Engines and demons , 2014 .

[112]  Masahito Ueda,et al.  Minimal energy cost for thermodynamic information processing: measurement and information erasure. , 2008, Physical review letters.

[113]  David H. Wolpert,et al.  Extending Landauer's Bound from Bit Erasure to Arbitrary Computation , 2015, 1508.05319.

[114]  R. Landauer,et al.  Irreversibility and heat generation in the computing process , 1961, IBM J. Res. Dev..

[115]  Rob R. de Ruyter van Steveninck,et al.  The metabolic cost of neural information , 1998, Nature Neuroscience.

[116]  Eric Smith Thermodynamics of natural selection II: Chemical Carnot cycles. , 2008, Journal of theoretical biology.

[117]  Eric Smith Thermodynamics of natural selection III: Landauer's principle in computation and chemistry. , 2008, Journal of theoretical biology.

[118]  Shizume Heat generation required by information erasure. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.