Information Entropy in Chemistry: An Overview

Basic applications of the information entropy concept to chemical objects are reviewed. These applications deal with quantifying chemical and electronic structures of molecules, signal processing, structural studies on crystals, and molecular ensembles. Recent advances in the mentioned areas make information entropy a central concept in interdisciplinary studies on digitalizing chemical reactions, chemico-information synthesis, crystal engineering, as well as digitally rethinking basic notions of structural chemistry in terms of informatics.

[1]  T. Borodina,et al.  H-H interaction in phenanthrene: Attraction or repulsion? , 2013, Journal of Structural Chemistry.

[2]  A. Barnard,et al.  Interfacial informatics , 2021, Journal of Physics: Materials.

[3]  P. Wright.  Entropy and disorder , 1970 .

[4]  O. Ori,et al.  Covalently Bonded Fullerene Nano-Aggregates (C60)n: Digitalizing Their Energy-Topology-Symmetry , 2021, Symmetry.

[5]  Matthias Dehmer,et al.  A history of graph entropy measures , 2011, Inf. Sci..

[6]  D. Sabirov,et al.  Fullerene–1,4-dioxane adducts: a DFT study of the structural features and molecular properties , 2020, Fullerenes, Nanotubes and Carbon Nanostructures.

[7]  S C Basak,et al.  Comparative study of lipophilicity versus topological molecular descriptors in biological correlations. , 1984, Journal of pharmaceutical sciences.

[8]  Thomas Böttcher,et al.  An Additive Definition of Molecular Complexity , 2016, J. Chem. Inf. Model..

[9]  David Koslicki,et al.  Topological entropy of DNA sequences , 2011, Bioinform..

[10]  D. G. Bonchev.  KOLMOGOROV'S INFORMATION, SHANNON'S ENTROPY, AND TOPOLOGICAL COMPLEXITY OFMOLECULES , 1995 .

[11]  A. A. Khuzin,et al.  Reversible luminescence switching of a photochromic fullerene[60]-containing spiropyran , 2019, Journal of Photochemistry and Photobiology A: Chemistry.

[12]  F. Escudero,et al.  Atoms in molecules , 1982 .

[13]  S. Krivovichev,et al.  Structural complexity of minerals: information storage and processing in the mineral world , 2013, Mineralogical Magazine.

[14]  F. Torrens,et al.  Information entropy-based classification of triterpenoids and steroids from Ganoderma. , 2015, Phytochemistry.

[15]  M. Ghorbani,et al.  Novel results on entropy-based measures of fullerenes , 2020 .

[16]  S. Robson,et al.  A new method to study genome mutations using the information entropy , 2021, bioRxiv.

[17]  Lai‐Sheng Wang,et al.  Beyond Classical Stoichiometry: Experiment and Theory , 2001 .

[18]  N. Trinajstic,et al.  Chemical Information Theory: Structural Aspects , 2009 .

[19]  Rainer Adelung,et al.  Investigation of the surface morphology on epitaxially grown fullerene structures , 2009 .

[20]  Sergey V. Krivovichev,et al.  Structure description, interpretation and classification in mineralogical crystallography , 2017 .

[21]  V. Sokolov.  Topological Ideas in Stereochemistry , 1973 .

[22]  D. Sabirov.  Information entropy changes in chemical reactions , 2018 .

[23]  A. Mohajeri,et al.  Shannon information entropy of fractional occupation probability as an electron correlation measure in atoms and molecules , 2009 .

[24]  Thomas D. Schneider,et al.  A brief review of molecular information theory , 2010, Nano Commun. Networks.

[25]  G. Jumarie.  A Critical Review of Shannon Information Theory , 1990 .

[26]  D. Sabirov.  A correlation between the mean polarizability of the “kinked” polycyclic aromatic hydrocarbons and the number of H…H bond critical points predicted by Atoms-in-Molecules theory , 2014 .

[27]  N. Nagaraj,et al.  Three perspectives on complexity: entropy, compression, subsymmetry , 2016, The European Physical Journal Special Topics.

[28]  Yongtang Shi,et al.  Entropy bounds for dendrimers , 2014, Appl. Math. Comput..

[29]  S. Hirono,et al.  DFT study of the influence of acetyl groups of cellulose acetate on its intrinsic birefringence and wavelength dependence. , 2019, Carbohydrate polymers.

[30]  J. L. González-Santander,et al.  Classification of flavonoid compounds by using entropy of information theory. , 2013, Phytochemistry.

[31]  Denis Sh. Sabirov,et al.  Activation energies and information entropies of helium penetration through fullerene walls. Insights into the formation of endofullerenes nX@C60/70 (n = 1 and 2) from the information entropy approach , 2016 .

[32]  P. Geerlings,et al.  Information carriers and (reading them through) information theory in quantum chemistry. , 2011, Physical chemistry chemical physics : PCCP.

[33]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[34]  T. Huynh-Dinh,et al.  The logic of chemical synthesis , 1996 .

[35]  F. Torrens,et al.  Classification of stilbenoid compounds by entropy of artificial intelligence. , 2014, Phytochemistry.

[36]  A. Kerber,et al.  Molecules in Silico: The Generation of Structural Formulae and Its Applications , 2004 .

[37]  Werner Henkel,et al.  Relationship between digital information and thermodynamic stability in bacterial genomes , 2016, EURASIP J. Bioinform. Syst. Biol..

[38]  Matthias Dehmer,et al.  Generalized graph entropies , 2011, Complex..

[39]  S. Krivovichev,et al.  Extraordinary structural complexity of ilmajokite: a multilevel hierarchical framework structure of natural origin , 2020, IUCrJ.

[40]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[41]  Isaac L. Chuang,et al.  Quantum Computation and Quantum Information: Frontmatter , 2010 .

[42]  M. Nespolo,et al.  Producing highly complicated materials. Nature does it better , 2020, Reports on progress in physics. Physical Society.

[43]  Sylvain Lavelle,et al.  The new scientific spirit , 1996 .

[44]  E. Kuruoglu,et al.  The information capacity of the genetic code: Is the natural code optimal? , 2017, Journal of theoretical biology.

[45]  R. Hartley.  Transmission of information , 1928 .

[46]  R. Bader.  Atoms in molecules : a quantum theory , 1990 .

[47]  Preliminary modelling as the first stage of targeted organic synthesis , 2021 .

[48]  Phuong Nguyen,et al.  Estimating configurational entropy of complex molecules: A novel variable transformation approach , 2009 .

[49]  A. Toro‐Labbé,et al.  Analyzing Kullback-Leibler information profiles: an indication of their chemical relevance. , 2009, Physical chemistry chemical physics : PCCP.

[50]  Roald Hoffmann,et al.  Representation in Chemistry , 1989 .

[51]  Ronnie Kosloff,et al.  Landauer’s Principle in a Quantum Szilard Engine without Maxwell’s Demon , 2019, Entropy.

[52]  Peter A. Williams,et al.  Structural complexity and crystallization: the Ostwald sequence of phases in the Cu2(OH)3Cl system (botallackite–atacamite–clinoatacamite) , 2017, Structural Chemistry.

[53]  T. Böttcher.  From Molecules to Life: Quantifying the Complexity of Chemical and Biological Systems in the Universe , 2017, Journal of Molecular Evolution.

[54]  George Karreman.  Topological information content and chemical reactions , 1955 .

[55]  S. Noorizadeh,et al.  N-Derivatives of Shannon entropy density as response functions. , 2020, Physical chemistry chemical physics : PCCP.

[56]  Eugene V. Koonin,et al.  The meaning of biological information , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[57]  TOPOLOGICAL FEATURES OF BOROPHOSPHATES WITH MIXED FRAMEWORKS: SYNTHESIS, CRYSTAL STRUCTURE OF FIRST ALUMINUM AND LITHIUM BOROPHOSPHATE Li3{Al2[BP4O16]}·2H2O AND COMPARATIVE CRYSTAL CHEMISTRY , 2020, Journal of Structural Chemistry.

[58]  M. Garcia‐Garibay,et al.  The entropic enlightenment of organic photochemistry: strategic modifications of intrinsic decay pathways using an information-based approach , 2010, Photochemical & photobiological sciences : Official journal of the European Photochemistry Association and the European Society for Photobiology.

[59]  P. Chambadal,et al.  Évolution et applications du concept d'entropie , 1963 .

[60]  Artemy Kolchinsky,et al.  Semantic information, autonomous agency and non-equilibrium statistical physics , 2018, Interface Focus.

[61]  Matthias Dehmer,et al.  Hosoya entropy of fullerene graphs , 2019, Appl. Math. Comput..

[62]  A. Thakkar.  A hierarchy for additive models of polarizability , 2012 .

[63]  M. Dehmer,et al.  Properties of Entropy-Based Topological Measures of Fullerenes , 2020, Mathematics.

[64]  Roman F. Nalewajski,et al.  Information-Theoretic Descriptors of Molecular States and Electronic Communications between Reactants , 2020, Entropy.

[65]  I. Ugi,et al.  Representation of Chemical Systems and Interconversions by be Matrices and Their Transformation Properties , 1971 .

[66]  J. Plášil.  Uranyl-oxide hydroxy-hydrate minerals: their structural complexity and evolution trends , 2017, European Journal of Mineralogy.

[67]  K. Koledina,et al.  Classification of isentropic molecules in terms of Shannon entropy , 2020 .

[68]  S. Noorizadeh,et al.  Shannon entropy as a new measure of aromaticity, Shannon aromaticity. , 2010, Physical chemistry chemical physics : PCCP.

[69]  Matthias Dehmer,et al.  Graph operations based on using distance-based graph entropies , 2018, Appl. Math. Comput..

[70]  D. Sabirov.  Information entropy of interstellar and circumstellar carbon-containing molecules: Molecular size against structural complexity , 2016 .

[71]  Danail Bonchev,et al.  Trends in information theory-based chemical structure codification , 2014, Molecular Diversity.

[72]  R. Parr,et al.  Information theory, atoms in molecules, and molecular similarity. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[73]  Alexander I Boldyrev,et al.  Developing paradigms of chemical bonding: adaptive natural density partitioning. , 2008, Physical chemistry chemical physics : PCCP.

[74]  Paul Geerlings,et al.  N-derivative of Shannon entropy of shape function for atoms , 2005 .

[75]  J. Koski,et al.  Experimental realization of a Szilard engine with a single electron , 2014, Proceedings of the National Academy of Sciences.

[76]  Danail Bonchev,et al.  Symmetry and information content of chemical structures , 1976 .

[77]  Eiji Ōsawa,et al.  Formation Mechanism of C60 under Nonequilibrium and Irreversible Conditions — An Annotation , 2012 .

[78]  E. Lutz,et al.  Experimental verification of Landauer’s principle linking information and thermodynamics , 2012, Nature.

[79]  Matthias Dehmer,et al.  On Properties of Distance-Based Entropies on Fullerene Graphs , 2019, Entropy.

[80]  Roman F. Nalewajski,et al.  Understanding Electronic Structure and Chemical Reactivity: Quantum-Information Perspective , 2019, Applied Sciences.

[81]  G. Odriozola,et al.  Entropy effects in self-assembling mechanisms: Also a view from the information theory , 2011 .

[82]  B. Kadomtsev.  Dynamics and information , 1994 .

[83]  Trygve Helgaker,et al.  Recent advances in wave function-based methods of molecular-property calculations. , 2012, Chemical reviews.

[84]  Peter Salamon,et al.  Applying Shannon's information theory to bacterial and phage genomes and metagenomes , 2013, Scientific Reports.

[85]  D. Sabirov,et al.  Information Entropy of Regular Dendrimer Aggregates and Irregular Intermediate Structures , 2021, Liquids.

[86]  Sergey V. Krivovichev,et al.  Complexity Parameters for Molecular Solids , 2021, Symmetry.

[87]  R. Hazen,et al.  Structural and chemical complexity of minerals: correlations and time evolution , 2017, European Journal of Mineralogy.

[88]  Jin Tao,et al.  The Hosoya Entropy of Graphs Revisited , 2019, Symmetry.

[89]  Denis Sh. Sabirov,et al.  Anisotropy of Polarizability of Fullerene Higher Adducts for Assessing the Efficiency of Their Use in Organic Solar Cells , 2013 .

[90]  Subhash C. Basak,et al.  Use of Topostructural, Topochemical, and Geometric Parameters in the Prediction of Vapor Pressure: A Hierarchical QSAR Approach , 1997, J. Chem. Inf. Comput. Sci..

[91]  H. Herzel,et al.  Estimating the entropy of DNA sequences. , 1997, Journal of theoretical biology.

[92]  V. Minkin.  Current trends in the development of A. M. Butlerov’s theory of chemical structure , 2012, Russian Chemical Bulletin.

[93]  D. Sabirov,et al.  Information entropy of oxygen allotropes. A still open discussion about the closed form of ozone , 2015 .

[94]  S. Krivovichev.  Polyoxometalate clusters in minerals: review and complexity analysis. , 2020, Acta crystallographica Section B, Structural science, crystal engineering and materials.

[95]  Sergio Hernández,et al.  A Brief Review of Generalized Entropies , 2018, Entropy.

[96]  On the calculations of Shannon’s entropy in atoms and molecules I: The continuous case in position and momentum spaces , 2019, Chemical Physics Letters.

[97]  Steven H. Bertz,et al.  Complexity of synthetic reactions. The use of complexity indices to evaluate reactions, transforms and disconnections , 2003 .

[98]  Rodolfo O. Esquivel,et al.  Shannon entropy of chemical changes: SN2 displacement reactions , 2000 .

[99]  Matthias Dehmer,et al.  Entropy and the Complexity of Graphs Revisited , 2012, Entropy.

[100]  Takahiro Sagawa,et al.  Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality , 2010, 1009.5287.

[101]  S. Krivovichev.  Structural complexity and configurational entropy of crystals. , 2016, Acta crystallographica Section B, Structural science, crystal engineering and materials.

[102]  Ottorino Ori,et al.  Isomers of the C84 fullerene: A theoretical consideration within energetic, structural, and topological approaches , 2018 .

[103]  Eiji Osawa,et al.  Information Entropy of Fullerenes , 2015, J. Chem. Inf. Model..

[104]  D. Sabirov,et al.  Information entropy of mixing molecules and its application to molecular ensembles and chemical reactions , 2020 .

[105]  David Thomas,et al.  DNA entropy reveals a significant difference in complexity between housekeeping and tissue specific gene promoters , 2015, Comput. Biol. Chem..

[106]  Michael Nosonovsky,et al.  Self-organization at the frictional interface for green tribology , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[107]  Mikhail Prokopenko,et al.  Information and Self-Organization: A Macroscopic Approach to Complex Systems, (3rd enlarged ed.). H. Haken. (2006, Springer.) 79.95 (hardcover), 262 pages. ISBN: 978-3-540-33021-9 , 2009, Artificial Life.

[108]  M. Garcia‐Garibay.  CHEMICAL REACTIVITY IN ORGANIZED MEDIA : STATISTICAL ENTROPY AND INFORMATION IN CRYSTALS AND ENZYMES , 1998 .

[109]  Charles H. Bennett,et al.  Notes on Landauer's Principle, Reversible Computation, and Maxwell's Demon , 2002, physics/0210005.

[110]  V. V. Ivanov,et al.  Structure as the source of information on the chemical organization of substance , 2013, Russian Journal of General Chemistry.

[111]  R. Nalewajski.  Resultant Information Descriptors, Equilibrium States and Ensemble Entropy † , 2021, Entropy.

[112]  Steven H. Bertz,et al.  The first general index of molecular complexity , 1981 .

[113]  V. B. Aleskovskii.  Information as a Factor of Self-Organization and Organization of Matter , 2002 .

[114]  T. Clark,et al.  Models of necessity , 2020, Beilstein journal of organic chemistry.

[115]  Ivan V. Stankevich,et al.  Topological Indices in Organic Chemistry , 1988 .

[116]  M. D. Bal’makov.  Information capacity of condensed systems , 1999 .