Towards Closed Loop Information: Predictive Information

Motivation: Classical definitions of information, such as the Shannon information, are designed for open loop systems because they define information on a channel which has an input and an output. …

[1]  Richard L. Brunson,et al.  Linear Control System Analysis and Design , 1988, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  E. Oja.  Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[3]  P. D. Roberts,et al.  Linear Control System Analysis and Design , 1982 .

[4]  B. Kosco.  Differential Hebbian learning , 1987 .

[5]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[6]  Geert Grooteplein Noord.  Adaptive Fields: Distributed Representations of Classically Conditioned Associations , 1991 .

[7]  G. J. Dalenoort,et al.  Inside Versus Outside , 1994 .

[8]  E. Glasersfeld.  Radical Constructivism: A Way of Knowing and Learning. Studies in Mathematics Education Series: 6. , 1995 .

[9]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[10]  John S. Denker,et al.  Neural Networks for Computing , 1998 .

[11]  Systemtheorie und Naturwissenschaft : eine interdisziplinäre Analyse von Niklas Luhmanns Werk , 2002 .

[12]  H. Von Foerster,et al.  On Self-Organizing Systems and Their Environments , 2003 .

[13]  Florentin Wörgötter,et al.  Isotropic Sequence Order Learning , 2003, Neural Computation.

[14]  Florentin Wörgötter,et al.  ISO Learning Approximates a Solution to the Inverse-Controller Problem in an Unsupervised Behavioral Paradigm , 2003, Neural Computation.

[15]  Seth Lloyd,et al.  Information-theoretic approach to the study of control systems , 2001, physics/0104007.

[16]  Chrystopher L. Nehaniv,et al.  Organization of the information flow in the perception-action loop of evolved agents , 2004, Proceedings. 2004 NASA/DoD Conference on Evolvable Hardware, 2004..

[17]  Florentin Wörgötter,et al.  Inside embodiment – what means embodiment to radical constructivists? , 2005 .

[18]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[19]  Florentin Wörgötter,et al.  Strongly Improved Stability and Faster Convergence of Temporal Sequence Learning by Using Input Correlations Only , 2006, Neural Computation.