Information flow and optimization in transcriptional regulation

In the simplest view of transcriptional regulation, the expression of a gene is turned on or off by changes in the concentration of a transcription factor (TF). We use recent data on noise levels in gene expression to show that it should be possible to transmit much more than just one regulatory bit. Realizing this optimal information capacity would require that the dynamic range of TF concentrations used by the cell, the input/output relation of the regulatory module, and the noise in gene expression satisfy certain matching relations, which we derive. These results provide parameter-free, quantitative predictions connecting independently measurable quantities. Although we have considered only the simplified problem of a single gene responding to a single TF, we find that these predictions are in surprisingly good agreement with recent experiments on the Bicoid/Hunchback system in the early Drosophila embryo and that this system achieves ∼90% of its theoretical maximum information transmission.

[1]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[2]  Richard A. Silverman On binary channels and their cascades , 1955, IRE Trans. Inf. Theory.

[3]  J. Monod,et al.  Genetic regulatory mechanisms in the synthesis of proteins. , 1961, Journal of molecular biology.

[4]  L. Wolpert Positional information and the spatial pattern of cellular differentiation. , 1969, Journal of theoretical biology.

[5]  Richard E. Blahut,et al.  Computation of channel capacity and rate-distortion functions , 1972, IEEE Trans. Inf. Theory.

[6]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[7]  C. Nüsslein-Volhard,et al.  The bicoid protein determines position in the Drosophila embryo in a concentration-dependent manner , 1988, Cell.

[8]  C. Nüsslein-Volhard,et al.  A gradient of bicoid protein in Drosophila embryos , 1988, Cell.

[9]  Wolfgang Driever,et al.  The bicoid protein is a positive regulator of hunchback transcription in the early Drosophila embryo , 1989, Nature.

[10]  K. Struhl,et al.  The gradient morphogen bicoid is a concentration-dependent transcriptional activator , 1989, Cell.

[11]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  Claude Desplan,et al.  Synergy between the hunchback and bicoid morphogens is required for anterior patterning in Drosophila , 1994, Cell.

[14]  H. Jäckle,et al.  From gradients to stripes in Drosophila embryogenesis: filling in the gaps. , 1996, Trends in genetics : TIG.

[15]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[16]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.

[17]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[18]  Anirvan M. Sengupta,et al.  Engineering aspects of enzymatic signal transduction: photoreceptors in the retina. , 2000, Biophysical journal.

[19]  Ertugrul M. Ozbudak,et al.  Regulation of noise in the expression of a single gene , 2002, Nature Genetics.

[20]  U. Alon,et al.  Detailed map of a cis-regulatory input function , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Mads Kærn,et al.  Noise in eukaryotic gene expression , 2003, Nature.

[22]  J. Raser,et al.  Control of Stochasticity in Eukaryotic Gene Expression , 2004, Science.

[23]  W. Bialek,et al.  Information-based clustering. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Dmitri Papatsenko,et al.  The role of binding site cluster strength in Bicoid-dependent patterning in Drosophila. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[25]  P. Swain,et al.  Gene Regulation at the Single-Cell Level , 2005, Science.

[26]  E. Cox,et al.  Real-Time Kinetics of Gene Activity in Individual Bacteria , 2005, Cell.

[27]  A. van Oudenaarden,et al.  Noise Propagation in Gene Networks , 2005, Science.

[28]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[29]  I. Nemenman,et al.  Optimal Signal Processing in Small Stochastic Biochemical Networks , 2006, PloS one.

[30]  Terence Hwa,et al.  Combinatorial transcriptional control of the lactose operon of Escherichia coli , 2007, Proceedings of the National Academy of Sciences.

[31]  W. Bialek,et al.  Probing the Limits to Positional Information , 2007, Cell.

[32]  W. Bialek,et al.  Stability and Nuclear Dynamics of the Bicoid Morphogen Gradient , 2007, Cell.

[33]  W. Bialek,et al.  The Role of Input Noise in Transcriptional Regulation , 2006, PloS one.

[34]  Gasper Tkacik,et al.  Information capacity of genetic regulatory elements. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Jeffrey W. Smith,et al.  Stochastic Gene Expression in a Single Cell , 2022 .