Spiking neural networks for higher-level information fusion

This paper presents a novel approach to higher-level (2+) information fusion and knowledge representation using semantic networks composed of coupled spiking neuron nodes. Networks of spiking neurons have been shown to exhibit synchronization, in which sub-assemblies of nodes become phase locked to one another. This phase locking reflects the tendency of biological neural systems to produce synchronized neural assemblies, which have been hypothesized to be involved in feature binding. The approach in this paper embeds spiking neurons in a semantic network, in which a synchronized sub-assembly of nodes represents a hypothesis about a situation. Likewise, multiple synchronized assemblies that are out-of-phase with one another represent multiple hypotheses. The initial network is hand-coded, but additional semantic relationships can be established by associative learning mechanisms. This approach is demonstrated with a simulated scenario involving the tracking of suspected criminal vehicles between meeting places in an urban environment.

[1]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[2]  Michael I. Jordan,et al.  Modular and hierarchical learning systems , 1998 .

[3]  Alan N. Steinberg,et al.  Revisions to the JDL data fusion model , 1999, Defense, Security, and Sensing.

[4]  David Horn,et al.  Collective excitation phenomena and their applications , 1999 .

[5]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[6]  C. Gray The Temporal Correlation Hypothesis of Visual Feature Integration Still Alive and Well , 1999, Neuron.

[7]  L. Shastri,et al.  From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony , 1993, Behavioral and Brain Sciences.

[8]  Wolf Singer Synchronization of neuronal responses as a putative binding mechanism , 1998 .

[9]  Christoph von der Malsburg,et al.  The What and Why of Binding: Review The Modeler's Perspective , 1999 .

[10]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[11]  G.A. Carpenter,et al.  Information fusion for image analysis: geospatial foundations for higher-level fusion , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[12]  R. White,et al.  Incremental Learning and Optimization of Hierarchical Clusterings with Art-Based Modular Networks , 2000 .

[13]  M. L. Hinman,et al.  Some computational approaches for situation assessment and impact assessment , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[14]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[15]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[16]  Lokendra Shastri,et al.  Advances in SHRUTI—A Neurally Motivated Model of Relational Knowledge Representation and Rapid Inference Using Temporal Synchrony , 1999, Applied Intelligence.

[17]  David A. Fay,et al.  Learn-while-tracking, feature discovery and fusion of high-resolution radar range profiles , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.