Design of a brain computer using the novel principles of output-driven operation and memory-based architecture

Abstract The brain is an organ especially differentiated to acquire algorithms in a self-organized fashion according to the genetic algorithm. These acquired algorithms allow the brain to respond to the ever-changing environment that surrounds it. We hypothesize that two general principles give the brain its auto-designing capacity and, consequently, the potential to acquire algorithms: (a) Output-driven operation; the brain receives numerous types of input signals to which it makes a single output at an instant in time. The output-driven operation principle implies that input signals change information within the system only when making an output. According to this principle, learning should be output-driven. Through this process, input signals are utilized by the system to select an output most suitable to its surrounding, resulting in an enhanced learning efficacy. (b) Memory-based architecture; the brain algorithm, once acquired according to the output-driven operation principle, is memorized in a non-erasable fashion for extended periods of time. Any newly acquired algorithms are added to those already acquired. Input signals leave their traces in the system according to the memory-based principle, even if they are not a strong enough stimulation to drive an output. The combination of output-driven operation and memory-based architecture endows the brain's learning algorithm with the property of predictability. Here we confirm these two principles of brain design by successfully implementing them in an autonomous mechanical device, namely a helicopter, that has a will to fly and ultimately acquires the motor control required to do so in a manner similar to a fledgling bird. We anticipate that these principles will eventually lead to the development of a brain computer as an engineering counterpart of a real brain.

[1]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[2]  D. Perrett,et al.  A differential neural response in the human amygdala to fearful and happy facial expressions , 1996, Nature.

[3]  Hiroshi Okamoto,et al.  Temporal Event Association and Output-Dependent Learning: A Proposed Scheme of Neural Molecular Connections , 1999, J. Adv. Comput. Intell. Intell. Informatics.

[4]  Hiroshi Tsujino,et al.  The Brain-Like Sensorimotor Control System , 2002, J. Intell. Robotic Syst..

[5]  Masao Ito The Cerebellum And Neural Control , 1984 .

[6]  D. Johnston,et al.  Neuromodulation of dendritic action potentials. , 1999, Journal of neurophysiology.

[7]  S P Wise,et al.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. , 1995, Cerebral cortex.

[8]  Mark H. Johnson,et al.  Newborns' preferential tracking of face-like stimuli and its subsequent decline , 1991, Cognition.

[9]  Julian Eggert,et al.  Modeling Neuronal Assemblies: Theory and Implementation , 2001, Neural Computation.

[10]  O. Hikosaka,et al.  Differential Roles of the Frontal Cortex, Basal Ganglia, and Cerebellum in Visuomotor Sequence Learning , 1998, Neurobiology of Learning and Memory.

[11]  Gen Matsumoto,et al.  A New Learning Rule for Temporal Sequence , 1994 .

[12]  D. McCormick,et al.  Control of firing mode of corticotectal and corticopontine layer V burst-generating neurons by norepinephrine, acetylcholine, and 1S,3R- ACPD , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  R. Cotterill Cooperation of the basal ganglia, cerebellum, sensory cerebrum and hippocampus: possible implications for cognition, consciousness, intelligence and creativity , 2001, Progress in Neurobiology.

[14]  Kenji Doya,et al.  What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? , 1999, Neural Networks.

[15]  J. Ewert,et al.  Neural modulation of visuomotor functions underlying prey-catching behaviour in anurans: perception, attention, motor performance, learning. , 2001, Comparative biochemistry and physiology. Part A, Molecular & integrative physiology.

[16]  Horn,et al.  Neural encoding of subject–object distance in a visual recognition system , 1998, The European journal of neuroscience.

[17]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.

[18]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[19]  Mitsuo Kawato,et al.  Neural network control for a closed-loop System using Feedback-error-learning , 1993, Neural Networks.

[20]  W. N. Ross,et al.  Muscarinic modulation of spike backpropagation in the apical dendrites of hippocampal CA1 pyramidal neurons. , 1997, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  W. Schultz Predictive reward signal of dopamine neurons. , 1998, Journal of neurophysiology.

[22]  Hiroshi Tsujino,et al.  A Cortical-type Modular Neural Network for Hypothetical Reasoning , 1997, Neural Networks.

[23]  B. Sakmann,et al.  A new cellular mechanism for coupling inputs arriving at different cortical layers , 1999, Nature.

[24]  Johan J Bolhuis,et al.  Early learning and the development of filial preferences in the chick , 1999, Behavioural Brain Research.

[25]  W. N. Ross,et al.  Serotonin modulates spike backpropagation and associated [Ca2+]i changes in the apical dendrites of hippocampal CA1 pyramidal neurons. , 1999, Journal of neurophysiology.

[26]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.