Cognitive Based Distributed Sensing, Processing, and Communication

INTRODUCTION The greatest challenge to modern sensor processing is computational complexity and limited communication bandwidth. Consider a multi sensor distributed image communication system for real time situation monitoring. An example of such system would be security video surveillance consisting of multiple cameras covering a certain area. Image sequences from the cameras provide multiple views of the same ABSTRACT Perception, cognition, and higher cognitive abilities of the mind are considered here within a neural modeling fields (NMF) paradigm. Its fundamental mathematical mechanism is a process " from vague-fuzzy to crisp, " called dynamic logic. The chapter discusses why this paradigm is necessary mathematically , and relates it to a psychological description of the mind. Surprisingly, the process from " vague to crisp " corresponds to Aristotelian understanding of mental functioning. Recent fMRI measurements confirmed this process in neural mechanisms of perception. After an overview of NMF, the chapter describes solutions to two important problems: target tracking and situation recognition. Both problems can be solved within the NMF framework using the same basic algorithm. The chapter then discusses the challenges of using NMF and outlines the directions of future research. area from different vantage points. The timing of the images is not synchronized. Human operators are usually overwhelmed by the amount of visual information that has to be processed in real time. There is a strong need for automated detection of events of interest and bringing them to operator's attention. The challenges for such automation are (1) information fusion, (2) object detection, classification, and tracking, and (3) situation classification. Information fusion associates the data from different cameras that originated from the same object (Hall & Llinas, 2001). This task is difficult due to multiple objects in the view, asynchronous image sequences, and the presence of a large number of irrelevant objects. A brute-force algorithm for testing all possible combinations of data points from each camera results in exponential computational time. Object detection and classification is often difficult due to high noise, occlusions by other objects, variations in size, shape, color, and other characteristics of objects falling within the same class (Bishop, 2006). Object tracking, similarly to information fusion, is challenging due to the data association problem (Bar-Shalom & Fortmann, 1988). Finding correspondences between image points that belong to consecutive images may require exponential computational time. Finally, situation classification requires consideration of multiple objects, their spatial relationships, and time evolution. Due to the …

[1]  Leonid I. Perlovsky,et al.  Conundrum of Combinatorial Complexity , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Leonid I. Perlovsky,et al.  Neural Networks for Improved Tracking , 2007, IEEE Transactions on Neural Networks.

[3]  R. W. Deming,et al.  Automatic buried mine detection using the maximum likelihood adaptive neural system (MLANS) , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[4]  Leonid Perlovsky,et al.  Simplifying heuristics versus careful thinking: Scientific analysis of millennial spiritual issues , 2008 .

[5]  Kim B. Housewright,et al.  Derivation and evaluation of improved tracking filter for use in dense multitarget environments , 1974, IEEE Trans. Inf. Theory.

[6]  Leonid I. Perlovsky,et al.  How language can help discrimination in the Neural Modelling Fields framework , 2008, Neural Networks.

[7]  Christian Sandor,et al.  Lessons Learned in Designing Ubiquitous Augmented Reality User Interfaces , 2007 .

[8]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[9]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[10]  J. Schindler,et al.  Multi-Target/Multi-Sensor Tracking using Only Range and Doppler Measurements , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[11]  S. Grossberg,et al.  Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, interstimulus interval, and secondary reinforcement. , 1987, Applied optics.

[12]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[13]  Leonid I. Perlovsky,et al.  Concurrent multi-target localization, data association, and navigation for a swarm of flying sensors , 2007, Inf. Fusion.

[14]  Bruce H. Thomas,et al.  Emerging technologies of augmented reality - interfaces and design , 2006 .

[15]  Wayne Piekarski,et al.  Real-Time 3D Design Modelling of Outdoor Structures Using Mobile Augmented Reality Systems , 2009 .

[16]  E. Halgren,et al.  Top-down facilitation of visual recognition. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Leonid I. Perlovsky,et al.  Maximum likelihood neural networks for sensor fusion and adaptive classification , 1991, Neural Networks.

[18]  Leonid Perlovsky,et al.  Intersections of mathematical, cognitive, and aesthetic theories of mind. , 2010 .

[19]  L.I Perlovsky,et al.  Neurally and Mathematically Motivated Architecture for Language and Thought , 2010, The open neuroimaging journal.

[20]  Leonid I. Perlovsky,et al.  Cognitively Inspired Neural Network for Recognition of Situations , 2010, Int. J. Nat. Comput. Res..

[21]  Brian D. Josephson.  An integrated theory of nervous system functioning embracing nativism and constructivism , 2000 .

[22]  L. I. Perlovsky.  Emotions, learning and control , 1999, Proceedings of the 1999 IEEE International Symposium on Intelligent Control Intelligent Systems and Semiotics (Cat. No.99CH37014).

[23]  L. Perlovsky,et al.  Track-Before-Detect of Multiple Slowly Moving Targets , 2007, 2007 IEEE Radar Conference.

[24]  L.A. Zadeh,et al.  Information granulation and its centrality in human and machine intelligence , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[25]  Leonid I. Perlovsky,et al.  Curiosity and pleasure , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[26]  Z. Harris,et al.  Foundations of language , 1941 .

[27]  L. Perlovsky,et al.  Concurrent Tracking and Detection of Slowly Moving Targets using Dynamic Logic , 2007, 2007 International Conference on Integration of Knowledge Intensive Multi-Agent Systems.

[28]  Leonid I. Perlovsky,et al.  Evolving Compositionality in Evolutionary Language Games , 2007, IEEE Transactions on Evolutionary Computation.

[29]  A. Ortony,et al.  What's basic about basic emotions? , 1990, Psychological review.