Thermodynamically-Efficient Local Computation and the Inefficiency of Quantum Memory Compression

Modularity dissipation identifies how locally-implemented computation entails costs beyond those required by Landauer's bound on thermodynamic computing. We establish a general theorem for efficient local computation, giving the necessary and sufficient conditions for a local operation to have zero modularity cost. Applied to thermodynamically-generating stochastic processes it confirms a conjecture that classical generators are efficient if and only if they satisfy retrodiction, which places minimal memory requirements on the generator. This extends immediately to quantum computation: Any quantum simulator that employs quantum memory compression cannot be thermodynamically efficient.

[1]  James P. Crutchfield,et al.  Strong and Weak Optimizations in Classical and Quantum Models of Stochastic Processes , 2018, Journal of Statistical Physics.

[2]  James P. Crutchfield,et al.  Leveraging Environmental Correlations: The Thermodynamics of Requisite Variety , 2016, ArXiv.

[3]  I. Chuang,et al.  Quantum Computation and Quantum Information: Introduction to the Tenth Anniversary Edition , 2010 .

[4]  M. Gu,et al.  Practical Unitary Simulator for Non-Markovian Complex Processes. , 2017, Physical review letters.

[5]  James P. Crutchfield,et al.  Computational Mechanics: Pattern and Prediction, Structure and Simplicity , 1999, ArXiv.

[6]  James P. Crutchfield,et al.  Correlation-powered Information Engines and the Thermodynamics of Self-Correction , 2016, Physical review. E.

[7]  James P. Crutchfield,et al.  Occam’s Quantum Strop: Synchronizing and Compressing Classical Cryptic Processes via a Quantum Channel , 2015, Scientific Reports.

[8]  James P. Crutchfield,et al.  Asymptotic Synchronization for Finite-State Sources , 2010, ArXiv.

[9]  John A. Gunnels,et al.  Leveraging Secondary Storage to Simulate Deep 54-qubit Sycamore Circuits , 2019, 1910.09534.

[10]  J. Crutchfield,et al.  Extreme Quantum Memory Advantage for Rare-Event Sampling , 2017 .

[11]  James P. Crutchfield,et al.  Thermal Efficiency of Quantum Memory Compression , 2020, Physical review letters.

[12]  Victor V. Albert.  Asymptotics of quantum channels: conserved quantities, an adiabatic limit, and matrix product states , 2018, Quantum.

[13]  M. S. Leifer,et al.  A Bayesian approach to compatibility, improvement, and pooling of quantum states , 2011, 1110.1085.

[14]  James P. Crutchfield,et al.  Extreme Quantum Advantage for Rare-Event Sampling , 2017, ArXiv.

[15]  R. Renner,et al.  Inadequacy of von Neumann entropy for characterizing extractable work , 2009, 0908.0424.

[16]  U. Maurer,et al.  Secret key agreement by public discussion from common information , 1993, IEEE Trans. Inf. Theory.

[17]  J. Crutchfield,et al.  Extreme Quantum Advantage when Simulating Classical Systems with Long-Range Interaction , 2017, Scientific Reports.

[18]  M. Ruskai.  Inequalities for quantum entropy: A review with conditions for equality , 2002, quant-ph/0205064.

[19]  Jayne Thompson,et al.  Thermodynamics of complexity and pattern manipulation. , 2015, Physical review. E.

[20]  James P. Crutchfield,et al.  Above and Beyond the Landauer Bound: Thermodynamics of Modularity , 2017, Physical Review X.

[21]  Quantum Sufficiency in the Operator Algebra Framework , 2014 .

[22]  D. Petz.  SUFFICIENCY OF CHANNELS OVER VON NEUMANN ALGEBRAS , 1988 .

[23]  Lloyd,et al.  Use of mutual information to decrease entropy: Implications for the second law of thermodynamics. , 1989, Physical review. A, General physics.

[24]  Stanford Goldman,et al.  Information theory , 1953 .

[25]  Aaron D. Wyner,et al.  The common information of two dependent random variables , 1975, IEEE Trans. Inf. Theory.

[26]  Travis S. Humble,et al.  Quantum supremacy using a programmable superconducting processor , 2019, Nature.

[27]  Andrew J. P. Garner.  Oracular information and the second law of thermodynamics , 2019, ArXiv.

[28]  Gavin E. Crooks,et al.  Quantum Operation Time Reversal , 2007, 0706.3749.

[29]  B. Baumgartner,et al.  The structures of state space concerning Quantum Dynamical Semigroups , 2011, 1101.3914.

[30]  James P. Crutchfield,et al.  Equivalence of History and Generator-Machines , 2012 .

[31]  Karoline Wiesner,et al.  Quantum mechanics can reduce the complexity of classical models , 2011, Nature Communications.

[32]  Christopher Jarzynski,et al.  Work and information processing in a solvable model of Maxwell’s demon , 2012, Proceedings of the National Academy of Sciences.

[33]  James P. Crutchfield,et al.  Exact Synchronization for Finite-State Sources , 2010, ArXiv.

[34]  R. Renner,et al.  Inadequacy of von Neumann entropy for characterizing extractable work , 2011 .

[35]  R. Feynman.  Simulating physics with computers , 1999 .

[36]  James Odell,et al.  Between order and chaos , 2011, Nature Physics.

[37]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[38]  D. Petz,et al.  Sufficiency in Quantum Statistical Inference , 2004, math-ph/0412093.

[39]  James P. Crutchfield,et al.  Information Symmetries in Irreversible Processes , 2011, Chaos.

[40]  James P. Crutchfield,et al.  A Closed-Form Shave from Occam's Quantum Razor: Exact Results for Quantum Compression , 2015, ArXiv.

[41]  D. Petz.  Sufficient subalgebras and the relative entropy of states of a von Neumann algebra , 1986 .

[42]  M. Lewenstein,et al.  Quantum Entanglement , 2020, Quantum Mechanics.

[43]  Abbas El Gamal,et al.  Exact common information , 2014, 2014 IEEE International Symposium on Information Theory.

[44]  L. Goddard.  Information Theory , 1962, Nature.

[45]  A. B. Boyd,et al.  Identifying functional thermodynamics in autonomous Maxwellian ratchets , 2015, 1507.01537.

[46]  Robert W. Spekkens,et al.  A mathematical theory of resources , 2014, Inf. Comput..

[47]  Mark M. Wilde,et al.  Recoverability in quantum information theory , 2015, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[48]  James P Crutchfield,et al.  Time's barbed arrow: irreversibility, crypticity, and stored information. , 2009, Physical review letters.

[49]  R. Landauer,et al.  Irreversibility and heat generation in the computing process , 1961, IBM J. Res. Dev..

[50]  T. J. Elliott,et al.  Optimal stochastic modeling with unitary quantum dynamics , 2018, Physical Review A.

[51]  Young,et al.  Inferring statistical complexity. , 1989, Physical review letters.

[52]  John Preskill,et al.  Quantum computing and the entanglement frontier , 2012, 1203.5813.

[53]  D. Petz.  Quantum Information Theory and Quantum Statistics , 2007 .

[54]  James P. Crutchfield,et al.  A Closed-Form Shave from Occam's Quantum Razor: Exact Results for Quantum Compression , 2015, ArXiv.

[55]  Denes Petz,et al.  Structure of Sufficient Quantum Coarse-Grainings , 2004 .

[56]  Daniel Ray Upper,et al.  Theory and algorithms for hidden Markov models and generalized hidden Markov models , 1998 .

[57]  James P. Crutchfield,et al.  Causal Asymmetry in a Quantum World , 2017, Physical Review X.

[58]  Raffaella Carbone,et al.  Irreducible decompositions and stationary states of quantum channels , 2015, 1507.08404.

[59]  Yuan Feng,et al.  The Structure of Decoherence-free Subsystems , 2018 .

[60]  A. Winter,et al.  Communications in Mathematical Physics Structure of States Which Satisfy Strong Subadditivity of Quantum Entropy with Equality , 2022 .