Irregularity and asynchrony in biologic network signals.

The principal focus of this chapter has been the description of both ApEn, a quantification of serial irregularity, and of cross-ApEn, a thematically similar measure of two-variable asynchrony (conditional irregularity). Several properties of ApEn facilitate its utility for biological time series analysis: (1) ApEn is nearly unaffected by noise of magnitude below a de facto specified filter level; (2) ApEn is robust to outliers; (3) ApEn can be applied to time series of 50 or more points, with good reproducibility; (4) ApEn is finite for stochastic, noisy deterministic, and composite (mixed) processes, these last of which are likely models for complicated biological systems; (5) increasing ApEn corresponds to intuitively increasing process complexity in the settings of (4); and (6) changes in ApEn have been shown mathematically to correspond to mechanistic inferences concerning subsystem autonomy, feedback, and coupling, in diverse model settings. The applicability to medium-sized data sets and general stochastic processes is in marked contrast to capabilities of "chaos" algorithms such as the correlation dimension, which are properly applied to low-dimensional iterated deterministic dynamical systems. The potential uses of ApEn to provide new insights in biological settings are thus myriad, from a complementary perspective to that given by classical statistical methods. ApEn is typically calculated by a computer program, with a FORTRAN listing for a "basic" code referenced above. It is imperative to view ApEn as a family of statistics, each of which is a relative measure of process regularity. For proper implementation, the two input parameters m (window length) and r (tolerance width, de facto filter) must remain fixed in all calculations, as must N, the data length, to ensure meaningful comparisons. Guidelines for m and r selection are indicated above. We have found normalized regularity to be especially useful, as in the growth hormone studies discussed above; "r" is chosen as a fixed percentage (often 20%) of the subject's SD. This version of ApEn has the property that it is decorrelated from process SD--it remains unchanged under uniform process magnification, reduction, and translation (shift by a constant). Cross-ApEn is generally applied to compare sequences from two distinct yet interwined variables in a network. Thus we can directly assess network, and not just nodal, evolution, under different settings--e.g., to directly evaluate uncoupling and/or changes in feedback and control. Hence, cross-ApEn facilitates analyses of output from myriad complicated networks, avoiding the requirement to fully model the underlying system. This is especially important, since accurate modeling of (biological) networks is often nearly impossible. Algorithmically and insofar as implementation and reproducibility properties are concerned, cross-ApEn is thematically similar to ApEn. Furthermore, cross-ApEn is shown to be complementary to the two most prominent statistical means of assessing multivariate series, correlation and power spectral methodologies. In particular, we highlight, both theoretically and by case study examples, the many physiological feedback and/or control systems and models for which cross-ApEn can detect significant changes in bivariate asynchrony, yet for which cross-correlation and cross-spectral methods fail to clearly highlight markedly changing features of the data sets under consideration. Finally, we introduce spatial ApEn, which appears to have considerable potential, both theoretically and empirically, in evaluating multidimensional lattice structures, to discern and quantify the extent of changing patterns, and for the emergence and dissolution of traveling waves, throughout multiple contexts within biology and chemistry.

[1]  J D Veldhuis,et al.  Greater disorderliness of ACTH and cortisol release accompanies pituitary-dependent Cushing's disease. , 1997, European journal of endocrinology.

[2]  Chris Chatfield,et al.  The Analysis of Time Series: An Introduction , 1990 .

[3]  M L Johnson,et al.  Enhanced basal and disorderly growth hormone secretion distinguish acromegalic from normal pulsatile growth hormone release. , 1994, The Journal of clinical investigation.

[4]  Steven M. Pincus,et al.  A regularity statistic for medical data analysis , 1991, Journal of Clinical Monitoring.

[5]  Karl M. Newell,et al.  Inter- and intra-limb coordination in arm tremor , 1996, Experimental Brain Research.

[6]  R. Fisher Statistical Methods for Research Workers , 1971 .

[7]  P. Brémaud Point processes and queues, martingale dynamics , 1983 .

[8]  R. Israel Convexity in the Theory of Lattice Gases , 1979 .

[9]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[10]  Benjamin Weiss,et al.  How Sampling Reveals a Process , 1990 .

[11]  George Sugihara,et al.  Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series , 1990, Nature.

[12]  Steven M. Pincus,et al.  Follicle-stimulating hormone is secreted more irregularly than luteinizing hormone in both humans and sheep. , 1998, The Journal of clinical investigation.

[13]  J. Parer,et al.  Validity of mathematical methods of quantitating fetal heart rate variability. , 1985, American journal of obstetrics and gynecology.

[14]  D. Aldous Probability Approximations via the Poisson Clumping Heuristic , 1988 .

[15]  G. P. King,et al.  Extracting qualitative dynamics from experimental data , 1986 .

[16]  Pincus Sm,et al.  Approximate Entropy: A Regularity Measure for Fetal Heart Rate Analysis , 1992, Obstetrics and gynecology.

[17]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[18]  S. Pincus Approximate entropy (ApEn) as a complexity measure. , 1995, Chaos.

[19]  Richard E. Blahut,et al.  Principles and practice of information theory , 1987 .

[20]  Steven M. Pincus,et al.  Approximate entropy: Statistical properties and applications , 1992 .

[21]  P. Grassberger,et al.  Estimation of the Kolmogorov entropy from a chaotic signal , 1983 .

[22]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[23]  A. Wolf,et al.  Determining Lyapunov exponents from a time series , 1985 .

[24]  S M Pincus,et al.  Greater signal regularity may indicate increased system isolation. , 1994, Mathematical biosciences.

[25]  David J. Thomson,et al.  Coherence established between atmospheric carbon dioxide and global temperature , 1990, Nature.

[26]  D. T. Kaplan,et al.  Aging and the complexity of cardiovascular dynamics. , 1991, Biophysical journal.

[27]  Robert Shaw Strange Attractors, Chaotic Behavior, and Information Flow , 1981 .

[28]  Arnold O. Allen,et al.  Probability, statistics and queueing theory - with computer science applications (2. ed.) , 1981, Int. CMG Conference.

[29]  D. Ruelle,et al.  Ergodic theory of chaos and strange attractors , 1985 .

[30]  R Fisher,et al.  Design of Experiments , 1936 .

[31]  Carl M. Harris,et al.  Fundamentals of queueing theory , 1975 .

[32]  W. Fleming,et al.  Deterministic and Stochastic Optimal Control , 1975 .

[33]  Steven M. Pincus,et al.  Approximate Entropy of Heart Rate as a Correlate of Postoperative Ventricular Dysfunction , 1993, Anesthesiology.

[34]  M L Johnson,et al.  Differential impact of age, sex steroid hormones, and obesity on basal versus pulsatile growth hormone secretion in men as assessed in an ultrasensitive chemiluminescence assay. , 1995, The Journal of clinical endocrinology and metabolism.

[35]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[36]  David J. Thomson,et al.  Time series analysis of Holocene climate data , 1990, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[37]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[38]  F. Yates,et al.  Dimensional analysis of nonlinear oscillations in brain, heart, and muscle , 1988 .

[39]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[40]  J. R. Jackson Networks of Waiting Lines , 1957 .

[41]  J D Veldhuis,et al.  Patients with Cushing's disease secrete adrenocorticotropin and cortisol jointly more asynchronously than healthy subjects. , 1998, The Journal of clinical endocrinology and metabolism.