The identification of nonlinear biological systems: Wiener kernel approaches

Detection, representation, and identification of nonlinearities in biological systems are considered. We begin by briefly but critically examining a well-known test of system nonlinearity, and point out that this test cannot be used to prove that a system is linear. We then concentrate on the representation of nonlinear systems by Wiener's orthogonal functional series, discussing its advantages, limitations, and biological applications. System identification through estimating the kernels in the functional series is considered in detail. An efficient time-domain method of correcting for coloring in inputs is examined and shown to result in significantly improved kernel estimates in a biologically realistic system.

[1]  M. Korenberg,et al.  Exact orthogonal kernel estimation from finite data records: Extending Wiener's identification of nonlinear systems , 1988, Annals of Biomedical Engineering.

[2]  K. Naka,et al.  White-Noise Analysis of a Neuron Chain: An Application of the Wiener Theory , 1972, Science.

[3]  T. Poggio,et al.  The Volterra Representation and the Wiener Expansion: Validity and Pitfalls , 1977 .

[4]  J. Barrett.  The Use of Functionals in the Analysis of Non-linear Physical Systems† , 1963 .

[5]  I. Hunter,et al.  Two-sided linear filter identification , 1983, Medical and Biological Engineering and Computing.

[6]  J. Barrett.  Functional Series Representation of Nonlinear Systems – Some Theoretical Comments , 1982 .

[7]  I. J. Leontaritis,et al.  Input-output parametric models for non-linear systems Part II: stochastic non-linear systems , 1985 .

[8]  K I Naka,et al.  Dissection of the neuron network in the catfish inner retina. IV. Bidirectional interactions between amacrine and ganglion cells. , 1990, Journal of neurophysiology.

[9]  E. Bedrosian,et al.  The output properties of Volterra systems (nonlinear systems with memory) driven by harmonic and Gaussian inputs , 1971 .

[10]  M. Korenberg.  Statistical Identification of Parallel Cascades of Linear and Nonlinear Systems , 1982 .

[11]  H M Sakai,et al.  Dissection of the neuron network in the catfish inner retina. I. Transmission to ganglion cells. , 1988, Journal of neurophysiology.

[12]  Vasilis Z. Marmarelis,et al.  Analysis of Physiological Systems , 1978, Computers in Biology and Medicine.

[13]  S. Billings,et al.  Correlation based model validity tests for non-linear models , 1986 .

[14]  L. Stark,et al.  The pupillary control system: Its non-linear adaptive and stochastic engineering design characteristics , 1969, Autom..

[15]  I W Hunter,et al.  NEXUS: a computer language for physiological systems and signal analysis. , 1984, Computers in biology and medicine.

[16]  R. Shapley,et al.  The nonlinear pathway of Y ganglion cells in the cat retina , 1979, The Journal of general physiology.

[17]  Andrew S. French,et al.  The Use of Walsh Functions in the Wiener Analysis of Nonlinear Systems , 1974, IEEE transactions on computers.

[18]  Lawrence Stark,et al.  Kernel method for nonlinear analysis: identification of a biological control system , 1975 .

[19]  R. Haber.  Nonlinearity Tests for Dynamic Processes , 1985 .

[20]  K. Naka,et al.  Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. 3. Two-input white-noise analysis. , 1973, Journal of neurophysiology.

[21]  M. Schetzen.  The Volterra and Wiener Theories of Nonlinear Systems , 1980 .

[22]  G. D. Mccann,et al.  A family of quasi-white random signals and its optimal use in biological system identification , 1977, Biological Cybernetics.

[23]  H M Sakai,et al.  Signal transmission in the catfish retina. V. Sensitivity and circuit. , 1987, Journal of neurophysiology.

[24]  Amar G Bose,et al.  A theory of nonlinear systems , 1956 .

[25]  L. Stark,et al.  Wiener G-function analysis as an approach to non-linear characteristics of human pupil light reflex. , 1968, Brain research.

[26]  I. W. Hunter,et al.  Generation of random sequences with jointly specified probability density and autocorrelation functions , 1983, Biological Cybernetics.

[27]  K. Naka,et al.  Nonlinear analysis: mathematical theory and biological applications. , 1986, Critical reviews in biomedical engineering.

[28]  K. Naka,et al.  Dynamics of the ganglion cell response in the catfish and frog retinas , 1987, The Journal of general physiology.

[29]  M. J. Korenberg,et al.  The identification of nonlinear biological systems: LNL cascade models , 1986, Biological Cybernetics.

[30]  M. Fréchet.  Sur les fonctionnelles continues , 1910 .

[31]  M. Schetzen.  A theory of non-linear system identification , 1974 .

[32]  W. Rugh.  Nonlinear System Theory: The Volterra / Wiener Approach , 1981 .

[33]  Vito Volterra,et al.  Theory of Functionals and of Integral and Integro-Differential Equations , 2005 .

[34]  H M Sakai,et al.  White-noise analysis in visual neuroscience , 1988, Visual Neuroscience.

[35]  G. Palm,et al.  On representation and approximation of nonlinear systems , 1979, Biological Cybernetics.

[36]  T. Poggio,et al.  Stochastic Identification Methods for Nonlinear Systems: An Extension of the Wiener Theory , 1978 .

[37]  L Stark,et al.  Pupillary control system: its nonlinear adaptive and stochastic engineering design characteristics. , 1968 .

[38]  Stephen A. Billings,et al.  An Overview of Nonlinear Systems Identification , 1985 .

[39]  M. Korenberg.  Fast Orthogonal Algorithms for Nonlinear System Identification and Time-Series Analysis , 1989 .

[40]  P. Johannesma,et al.  Maximum-entropy approximations of stochastic nonlinear transductions: An extension of the wiener theory , 1986, Biological Cybernetics.

[41]  Stanley A. Klein,et al.  Nonlinear systems analysis with non-Gaussian white stimuli; General basis functionals and kernels (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[42]  P. Várlaki,et al.  Tests for Linearity and Bilinearity of Dynamic Systems , 1985 .

[43]  A. S. French,et al.  Measuring the Wiener kernels of a non-linear system using the fast Fourier transform algorithm† , 1973 .

[44]  M. Korenberg.  Identifying Noisy Cascades of Linear and Static Nonlinear Systems , 1985 .

[45]  Michael J. Korenberg,et al.  Identification of Intensive Nonlinearities in Cascade Models of Visual Cortex and its Relation to Cell Classification , 1989 .

[46]  M. J. Korenberg,et al.  White-noise analysis of nonlinear behavior in an insect sensory neuron: Kernel and cascade approaches , 1988, Biological Cybernetics.

[47]  S. A. Billings,et al.  Structure Detection and Model Validity Tests in the Identification of Nonlinear Systems , 1983 .

[48]  S. Zohar,et al.  Correction to "Fortran subroutines for the solution of Toeplitz sets of linear equations" , 1980 .

[49]  Lawrence W. Stark,et al.  The Pupil as a Paradigm for Neurological Control Systems , 1984, IEEE Transactions on Biomedical Engineering.

[50]  H M Sakai,et al.  Signal transmission in the catfish retina. IV. Transmission to ganglion cells. , 1987, Journal of neurophysiology.

[51]  S. Yasui.  Wiener-like fourier kernels for nonlinear system identification and synthesis (nonanalytic cascade, bilinear, and feedback cases) , 1982 .

[52]  N. Wiener,et al.  Nonlinear Problems in Random Theory , 1964 .

[53]  Y. Goussard,et al.  An improvement of the Lee and Schetzen cross-correlation method , 1985 .

[54]  M. J. Korenberg,et al.  The identification of nonlinear biological systems: Wiener and Hammerstein cascade models , 1986, Biological Cybernetics.

[55]  M. Korenberg.  Identifying nonlinear difference equation and functional expansion representations: The fast orthogonal algorithm , 2006, Annals of Biomedical Engineering.

[56]  R. Haber.  Structure Identification of Block-Oriented Models Based on the Volterra Kernels , 1985 .

[57]  R. B. Melton,et al.  Wiener Functionals for an Ν-Level Uniformly Distributed Discrete Random Process , 1982 .

[58]  S. Yasui.  Stochastic functional fourier series, Volterra series, and nonlinear systems analysis , 1979 .

[59]  J. Victor,et al.  The fractal dimension of a test signal: Implications for system identification procedures , 1987, Biological Cybernetics.

[60]  Y. W. Lee,et al.  Measurement of the Wiener Kernels of a Non-linear System by Cross-correlation† , 1965 .

[61]  B. Knight,et al.  Nonlinear analysis with an arbitrary stimulus ensemble , 1979 .

[62]  Klein,et al.  Nonlinear directionally selective subunits in complex cells of cat striate cortex. , 1987, Journal of neurophysiology.

[63]  M. Schetzen,et al.  Nonlinear system modeling based on the Wiener theory , 1981, Proceedings of the IEEE.

[64]  Martin Schetzen,et al.  Determination of optimum nonlinear systems for generalized error criteria based on the use of gate functions , 1965, IEEE Trans. Inf. Theory.

[65]  H. Sakai,et al.  Dissection of the neuron network in the catfish inner retina. II. Interactions between ganglion cells. , 1988, Journal of neurophysiology.

[66]  Stephen A. Billings,et al.  Identification of systems containing linear dynamic and static nonlinear elements , 1982, Autom..

[67]  A S French,et al.  A nonlinear cascade model for action potential encoding in an insect sensory neuron. , 1989, Biophysical journal.

[68]  M J Korenberg,et al.  Dissection of the neuron network in the catfish inner retina. III. Interpretation of spike kernels. , 1989, Journal of neurophysiology.

[69]  K I Naka,et al.  Dissection of the neuron network in the catfish inner retina. V. Interactions between NA and NB amacrine cells. , 1990, Journal of neurophysiology.

[70]  H. I. Krausz,et al.  Identification of nonlinear systems using random impulse train inputs , 1975, Biological Cybernetics.