A blueprint for higher-level fusion systems

This paper contends that demands on the data fusion community are beginning to exceed its historical roots in sensor fusion, by requiring greater development of automated situation and impact assessments and more appropriate integration with humans engaged in fusion activity. The paper offers a seven building block blueprint for the design of higher-level fusion systems. The first building block involves a deconstruction of the JDL model to apply it beyond machine based fusion. The second addresses machine representation for automated situation and impact assessments, while the third examines machine reasoning for automated situation and impact assessments. The fourth building block then reconstructs a unified framework for automated object, situation and impact assessments so as to accommodate both of the previous building blocks and the traditional approach to sensor fusion. Distributed data fusion constitutes the subsequent building block. The automated presentation of automated situation and impact assessments serves as the sixth building block, before the issue of human involvement in higher-level fusion systems is canvassed. Existing implementations of the various building blocks are referenced rather than discussed in any detail. The aim of the paper is to expose the overarching framework for these higher-level fusion systems without recourse to their considerable underlying complexity.

[1]  Hedvig Kjellström,et al.  An information fusion demonstrator for tactical intelligence processing in network-based defense , 2007, Inf. Fusion.

[2]  D. J. Barrett,et al.  Model-Data Fusion , 2003 .

[3]  D. A. Lambert,et al.  Ubiquitous command and control , 2007, 1999 Information, Decision and Control. Data and Information Fusion Symposium, Signal Processing and Communications Symposium and Decision and Control Symposium. Proceedings (Cat. No.99EX251).

[4]  J. Barnes The Complete Works of Aristotle , 1984 .

[5]  Michael R. Genesereth,et al.  Logical foundations of artificial intelligence , 1987 .

[6]  Dale A. Lambert A Unification of Sensor and Higher-Level Fusion , 2006, 2006 9th International Conference on Information Fusion.

[7]  Chen C. Chang,et al.  Model Theory: Third Edition (Dover Books On Mathematics) By C.C. Chang;H. Jerome Keisler;Mathematics , 1966 .

[8]  Michael Broughton,et al.  Virtual planning rooms (ViPR): a 3D visualisation environment for hierarchical information , 2006, AUIC.

[9]  P. Taplin,et al.  Conversing with Franco , FOCAL ’ s Virtual Adviser , 2002 .

[10]  Dale Lambert Automating cognitive routines , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[11]  Alan N. Steinberg,et al.  Rethinking the JDL Data Fusion Levels , 2005 .

[12]  Aristotle The Complete Works Of Aristotle , 1954 .

[13]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[14]  Immanuel Kant Kritik Der Reinen Vernunft , 2004 .

[15]  D. Davidson Truth and meaning , 2004, Synthese.

[16]  James Reason,et al.  Human Error , 1990 .

[17]  J. Scholz,et al.  A Dialectic for Network Centric Warfare , 2005 .

[18]  Alan N. Steinberg,et al.  Revisions to the JDL data fusion model , 1999, Defense, Security, and Sensing.

[19]  Dominique Estival,et al.  Spoken Dialogue for Virtual Advisers in a semi-immersive Command and Control environment , 2003, SIGDIAL Workshop.

[20]  Bruce J. MacLennan,et al.  Principles of Programming Languages , 1983 .

[21]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[22]  Daniel C. Dennett,et al.  Brainstorms: Philosophical Essays on Mind and Psychology , 1981 .

[23]  Fulvio Gini,et al.  A Model for a Human Decision-Maker in a Command and Control Radar System: Surveillance Tracking of Multiple Targets , 2006, 2006 9th International Conference on Information Fusion.

[24]  Dominique Estival,et al.  Towards Ontology-based Natural Language Processing , 2004, NLPXML@ACL.

[25]  Ernest Lepore,et al.  New directions in semantics , 1987, Cognitive science series : Collections.

[26]  L. Wittgenstein Tractatus Logico-Philosophicus , 2021, Nordic Wittgenstein Review.

[27]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[28]  Christopher K. Riesbeck,et al.  Inside Case-Based Reasoning , 1989 .

[29]  Colin McGinn,et al.  The Structure of Content , 2002 .

[30]  N. Block Introduction: What Is Functionalism? , 1980 .

[31]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[32]  Don Perugini,et al.  Agents for logistics: a provisional agreement approach , 2006 .

[33]  Don Perugini,et al.  Dynamic agent systems in the CoAX Binni 2002 experiment , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[34]  H. Putnam Meaning and Reference , 1973 .

[35]  Corrado Böhm,et al.  Flow diagrams, turing machines and languages with only two formation rules , 1966, CACM.

[36]  Franklin E White,et al.  Data Fusion Lexicon , 1991 .

[37]  K. Maier INQUIRY , 2007 .

[38]  Bruce J. MacLennan Principles of programming languages - design, evaluation, and implementation , 1987 .

[39]  G. Frege On Sense and Reference , 1948 .

[40]  Jörg P. Müller,et al.  COOPERATIVE TRANSPORTATION SCHEDULING : AN APPLICATION DOMAIN FOR DAI , 1996 .

[41]  David S Alberts,et al.  Network Centric Warfare: Developing and Leveraging Information Superiority , 1999 .

[42]  C. Nowak,et al.  The semantic challenge for situation assessments , 2005, 2005 7th International Conference on Information Fusion.

[43]  Edsger W. Dijkstra,et al.  A Discipline of Programming , 1976 .

[44]  Keith Devlin,et al.  Logic and information , 1991 .

[45]  Leon Sterling,et al.  Distributed information fusion agents , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[46]  Carl G. Looney,et al.  Exploring fusion architecture for a common operational picture , 2001, Inf. Fusion.

[47]  Michael Broughton,et al.  The FOCAL Point – Multimodal Dialogue with Virtual Geospatial Displays , 2005 .

[48]  Dale A. Lambert,et al.  First-Order Bayesian Reasoning , 1998, Australian Joint Conference on Artificial Intelligence.

[49]  R. Montague,et al.  The Semantic Conception of Truth and the Foundations of Semantics , 1996 .

[50]  D. A. Lambert Assessing situations , 1999, 1999 Information, Decision and Control. Data and Information Fusion Symposium, Signal Processing and Communications Symposium and Decision and Control Symposium. Proceedings (Cat. No.99EX251).

[51]  J. Hintikka On denoting what? , 2005, Synthese.

[52]  Dale Lambert Grand challenges of information fusion , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[53]  R. Gunaratna Inside Al Qaeda: Global Network of Terror , 2002 .

[54]  Erik Blasch,et al.  Level 5: user refinement to aid the fusion process , 2003, SPIE Defense + Commercial Sensing.

[55]  D. A. Lambert Situations for situation awareness , 2001 .

[56]  David-Hillel Ruben,et al.  An Essay on Facts , 1989 .

[57]  M. W. Shields An Introduction to Automata Theory , 1988 .

[58]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[59]  T. Nagel What is it like to be a Bat , 1974 .

[60]  Volker Haarslev,et al.  High Performance Reasoning with Very Large Knowledge Bases: A Practical Case Study , 2001, IJCAI.

[61]  Ian Horrocks,et al.  From SHIQ and RDF to OWL: the making of a Web Ontology Language , 2003, J. Web Semant..

[62]  J. Fodor,et al.  Psychosemantics: The Problem of Meaning in the Philosophy of Mind , 1988 .

[63]  Gilbert Harman,et al.  Nonsolipsistic) Conceptual Role Semantics , 1999 .

[64]  Saul A. Kripke,et al.  Naming and Necessity , 1980 .

[65]  N. Cocchiarella,et al.  Situations and Attitudes. , 1986 .

[66]  Dale A. Lambert,et al.  Formal Theories for Semantic Fusion , 2006, 2006 9th International Conference on Information Fusion.

[67]  Galina L. Rogova,et al.  An Ontological Analysis of Threat and Vulnerability , 2006, 2006 9th International Conference on Information Fusion.

[68]  Ian Horrocks,et al.  A Description Logic with Transitive and Inverse Roles and Role Hierarchies , 1999, J. Log. Comput..

[69]  James Llinas,et al.  Revisiting the JDL Data Fusion Model II , 2004 .

[70]  Ian Horrocks,et al.  OIL in a Nutshell , 2000, EKAW.

[71]  J. K. Mish'alani Thought and Object , 1962 .

[72]  N. Block Readings in philosophy of psychology , 1980 .

[73]  T. Nagel Mortal Questions: What is it like to be a bat? , 2012 .