Assessing Serial Irregularity and Its Implications for Health

Abstract: Approximate entropy (ApEn) is a recently formulated family of parameters and statistics quantifying regularity (orderliness) in serial data, with developments within theoretical mathematics as well as numerous applications to multiple biological contexts. We discuss the motivation for ApEn development, from the study of inappropriate application of dynamical systems (complexity) algorithms to general time‐series settings. ApEn is scale invariant and model independent, evaluates both dominant and subordinant patterns in data, and discriminates series for which clear feature recognition is difficult. ApEn is applicable to systems with at least 50 data points and to broad classes of models: it can be applied to discriminate both general classes of correlated stochastic processes, as well as noisy deterministic systems. Moreover, ApEn is complementary to spectral and autocorrelation analyses, providing effective discriminatory capability in instances in which the aforementioned measures exhibit minimal distinctions. Representative ApEn applications to human aging studies, based on both heart rate and endocrinologic (hormonal secretory) time series, are featured. Heart rate (HR) studies include gender‐ and age‐related changes in HR dynamics in older subjects, and analyses of “near‐SIDS” infants. Endocrinologic applications establish clear quantitative changes in joint LH‐testosterone secretory dynamics in older versus younger men (a “partial male menopause”), via cross‐ApEn, a related two‐variable asynchrony formulation; a disruption in LH‐FSH‐NPT (penile tumescence) synchrony in older subjects; and changes in LH‐FSH secretory dynamics across menopause. The capability of ApEn to assess relatively subtle disruptions, typically found earlier in the history of a subject than mean and variance changes, holds the potential for enhanced preventative and earlier interventionist strategies.

[1]  W. White,et al.  Gonadotropin-Releasing Hormone: One Polypeptide Regulates Secretion of Luteinizing and Follicle-Stimulating Hormones , 1971, Science.

[2]  A. R. Midgley,et al.  Regulation of human gonadotropins. X. Episodic fluctuation of LH during the menstrual cycle. , 1971, The Journal of clinical endocrinology and metabolism.

[3]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[4]  F. Naftolin,et al.  Pulsatile patterns of gonadotropin release in subjects with and without ovarian function. , 1972, The Journal of clinical endocrinology and metabolism.

[5]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[6]  R. Santen,et al.  Episodic luteinizing hormone secretion in man. Pulse analysis, clinical interpretation, physiologic mechanisms. , 1973, The Journal of clinical investigation.

[7]  R. Santen,et al.  EPISODIC LUTEINIZING HORMONE SECRETION IN MAN , 1974 .

[8]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[9]  Chris Chatfield,et al.  The Analysis of Time Series , 1990 .

[10]  Chris Chatfield,et al.  The Analysis of Time Series: An Introduction , 1981 .

[11]  Robert Shaw Strange Attractors, Chaotic Behavior, and Information Flow , 1981 .

[12]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[13]  P. Grassberger,et al.  Estimation of the Kolmogorov entropy from a chaotic signal , 1983 .

[14]  J. Butler,et al.  Neuroendocrine regulation of the corpus luteum in the human. Evidence for pulsatile progesterone secretion. , 1984, The Journal of clinical investigation.

[15]  D. Ruelle,et al.  Ergodic theory of chaos and strange attractors , 1985 .

[16]  A. Wolf,et al.  Determining Lyapunov exponents from a time series , 1985 .

[17]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[18]  G. P. King,et al.  Extracting qualitative dynamics from experimental data , 1986 .

[19]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[20]  A. Rogol,et al.  Contemporary aspects of discrete peak-detection algorithms. I. The paradigm of the luteinizing hormone pulse signal in men. , 1988, Endocrine reviews.

[21]  F. Yates,et al.  Dimensional analysis of nonlinear oscillations in brain, heart, and muscle , 1988 .

[22]  M L Johnson,et al.  Random and Non‐Random Coincidence Between Luteinizing Hormone Peaks and Follicle‐Stimulating Hormone, Alpha Subunit, Prolactin and Gonadotropin‐Releasing Hormone ulsations , 1989, Journal of neuroendocrinology.

[23]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[24]  Benjamin Weiss,et al.  How Sampling Reveals a Process , 1990 .

[25]  George Sugihara,et al.  Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series , 1990, Nature.

[26]  David J. Thomson,et al.  Coherence established between atmospheric carbon dioxide and global temperature , 1990, Nature.

[27]  David J. Thomson,et al.  Time series analysis of Holocene climate data , 1990, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[28]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[29]  D. T. Kaplan,et al.  Aging and the complexity of cardiovascular dynamics. , 1991, Biophysical journal.

[30]  Steven M. Pincus,et al.  Approximate Entropy: A Regularity Measure for Fetal Heart Rate Analysis , 1992, Obstetrics and gynecology.

[31]  Pincus Sm,et al.  Approximate Entropy: A Regularity Measure for Fetal Heart Rate Analysis , 1992, Obstetrics and gynecology.

[32]  Steven M. Pincus,et al.  Approximate entropy: Statistical properties and applications , 1992 .

[33]  Steven M. Pincus Approximating Markov chains. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[34]  M L Johnson,et al.  Contemporary aspects of discrete peak-detection algorithms. II. The paradigm of the luteinizing hormone pulse signal in women. , 1992, Endocrine reviews.

[35]  Steven M. Pincus,et al.  Quantification of hormone pulsatility via an approximate entropy algorithm. , 1992, The American journal of physiology.

[36]  S. Alexander,et al.  Secretory patterns and rates of gonadotropin-releasing hormone, follicle-stimulating hormone, and luteinizing hormone revealed by intensive sampling of pituitary venous blood in the luteal phase mare. , 1993, Endocrinology.

[37]  Steven M. Pincus,et al.  Approximate Entropy of Heart Rate as a Correlate of Postoperative Ventricular Dysfunction , 1993, Anesthesiology.

[38]  G G Haddad,et al.  Heart rate control in normal and aborted-SIDS infants. , 1993, The American journal of physiology.

[39]  S M Pincus,et al.  Greater signal regularity may indicate increased system isolation. , 1994, Mathematical biosciences.

[40]  A L Goldberger,et al.  Physiological time-series analysis: what does regularity quantify? , 1994, The American journal of physiology.

[41]  M L Johnson,et al.  Enhanced basal and disorderly growth hormone secretion distinguish acromegalic from normal pulsatile growth hormone release. , 1994, The Journal of clinical investigation.

[42]  A L Goldberger,et al.  Gender- and age-related differences in heart rate dynamics: are women more complex than men? , 1994, Journal of the American College of Cardiology.

[43]  S. Pincus Approximate entropy (ApEn) as a complexity measure. , 1995, Chaos.

[44]  M L Johnson,et al.  Differential impact of age, sex steroid hormones, and obesity on basal versus pulsatile growth hormone secretion in men as assessed in an ultrasensitive chemiluminescence assay. , 1995, The Journal of clinical endocrinology and metabolism.

[45]  J D Veldhuis,et al.  Increased disorderliness and amplified basal and pulsatile aldosterone secretion in patients with primary aldosteronism. , 1995, The Journal of clinical endocrinology and metabolism.

[46]  Steven M. Pincus,et al.  Older males secrete luteinizing hormone and testosterone more irregularly, and jointly more asynchronously, than younger males. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[47]  S. Pincus,et al.  Randomness and degrees of irregularity. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[48]  J D Veldhuis,et al.  Females secrete growth hormone with more process irregularity than males in both humans and rats. , 1996, The American journal of physiology.

[49]  L P Eberle,et al.  Preliminary evidence for the evolution in complexity of heart rate dynamics during autonomic maturation in neonatal swine. , 1997, Journal of the autonomic nervous system.

[50]  J D Veldhuis,et al.  Increased disorderliness of basal insulin release, attenuated insulin secretory burst mass, and reduced ultradian rhythmicity of insulin secretion in older individuals. , 1997, The Journal of clinical endocrinology and metabolism.

[51]  V. Padmanabhan,et al.  Neuroendocrine Control of Follicle-Stimulating Hormone (FSH) Secretion. I. Direct Evidence for Separate Episodic and Basal Components of FSH Secretion1. , 1997, Endocrinology.

[52]  T R Johnson,et al.  Complementary and non-coincident increases in heart rate variability and irregularity during fetal development. , 1997, Clinical science.

[53]  Steven M. Pincus,et al.  Effects of age on the irregularity of LH and FSH serum concentrations in women and men. , 1997, American Journal of Physiology.

[54]  R E Kalman,et al.  Not all (possibly) "random" sequences are created equal. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[55]  J D Veldhuis,et al.  Disorderly and nonstationary insulin secretion in relatives of patients with NIDDM. , 1997, The American journal of physiology.

[56]  J D Veldhuis,et al.  Greater disorderliness of ACTH and cortisol release accompanies pituitary-dependent Cushing's disease. , 1997, European journal of endocrinology.

[57]  I. Robinson,et al.  Differential orderliness of the GH release process in castrate male and female rats. , 1998, American journal of physiology. Regulatory, integrative and comparative physiology.

[58]  Use of approximate entropy measurements to classify ventricular tachycardia and fibrillation , 1998 .

[59]  S. Pincus,et al.  A recipe for randomness. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Steven M. Pincus,et al.  Follicle-stimulating hormone is secreted more irregularly than luteinizing hormone in both humans and sheep. , 1998, The Journal of clinical investigation.

[61]  J D Veldhuis,et al.  Patients with Cushing's disease secrete adrenocorticotropin and cortisol jointly more asynchronously than healthy subjects. , 1998, The Journal of clinical endocrinology and metabolism.

[62]  Peter Van Leeuwen,et al.  Evidence of phase transitions in heart period dynamics , 1998, Biological Cybernetics.

[63]  J. Veldhuis,et al.  Augmented frequency and mass of LH discharged per burst are accompanied by marked disorderliness of LH secretion in adolescents with polycystic ovary syndrome. , 1998, European journal of endocrinology.

[64]  A Statistical Feature of Genetic Sequences , 1998 .

[65]  S. Schuckers,et al.  Use of approximate entropy measurements to classify ventricular tachycardia and fibrillation. , 1998, Journal of electrocardiology.

[66]  N Radhakrishnan,et al.  Estimating regularity in epileptic seizure time-series data. A complexity-measure approach. , 1998, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[67]  M. Engoren,et al.  Approximate entropy of respiratory rate and tidal volume during weaning from mechanical ventilation. , 1998, Critical care medicine.

[68]  H. Huikuri,et al.  Altered complexity and correlation properties of R-R interval dynamics before the spontaneous onset of paroxysmal atrial fibrillation. , 1999, Circulation.

[69]  J D Veldhuis,et al.  Jointly amplified basal and pulsatile growth hormone (GH) secretion and increased process irregularity in women with anorexia nervosa: indirect evidence for disruption of feedback regulation within the GH-insulin-like growth factor I axis. , 1999, The Journal of clinical endocrinology and metabolism.

[70]  Abnormal cardiac autonomic activity and complexity in newly diagnosed and untreated hypertensive patients after general anesthesia. , 1999, Clinical and experimental hypertension.

[71]  J D Veldhuis,et al.  Disruption of the young-adult synchrony between luteinizing hormone release and oscillations in follicle-stimulating hormone, prolactin, and nocturnal penile tumescence (NPT) in healthy older men. , 1999, The Journal of clinical endocrinology and metabolism.

[72]  J. Bruhn,et al.  Electroencephalogram Approximate Entropy Correctly Classifies the Occurrence of Burst Suppression Pattern as Increasing Anesthetic Drug Effect , 2000, Anesthesiology.

[73]  J. Bruhn,et al.  Approximate Entropy as an Electroencephalographic Measure of Anesthetic Drug Effect during Desflurane Anesthesia , 2000, Anesthesiology.

[74]  Fang Chen,et al.  Dynamic process of information transmission complexity in human brains , 2000, Biological Cybernetics.

[75]  J D Veldhuis,et al.  Disruption of the joint synchrony of luteinizing hormone, testosterone, and androstenedione secretion in adolescents with polycystic ovarian syndrome. , 2001, The Journal of clinical endocrinology and metabolism.