Evaluation of the Effectiveness of Machine-Based Situation Assessment

Abstract : The Information Fusion Panel within The Technical Cooperation Program (TTCP) is developing algorithms to perform machine-based situation assessment to assist human operators in complex situations. This report proposes a technique to measure the effectiveness of these algorithms in a simulation environment where ground truth is well-defined. In addition, this report models the situation assessment algorithms abstractly using random inference networks, and examines how errors (damage) spread through the inference networks. This models deficiencies in the object assessment as input to the situation assessment algorithm.

[1]  Guanrong Chen,et al.  Complex networks: small-world, scale-free and beyond , 2003 .

[2]  Dale A. Lambert,et al.  STDF model based maritime situation assessments , 2007, 2007 10th International Conference on Information Fusion.

[3]  Michael Schroeder,et al.  A Corpus-Driven Approach for Design, Evolution and Alignment of Ontologies , 2006, Proceedings of the 2006 Winter Simulation Conference.

[4]  T. Rohlf,et al.  Damage spreading and criticality in finite random dynamical networks. , 2007, Physical review letters.

[5]  S. Kauffman.  Metabolic stability and epigenesis in randomly constructed genetic nets. , 1969, Journal of theoretical biology.

[6]  Patrick Lambrix,et al.  SAMBO - A system for aligning and merging biomedical ontologies , 2006, J. Web Semant..

[7]  Silvana Castano,et al.  Matching techniques for resource discovery in distributed systems using heterogeneous ontology descriptions , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[8]  Dale Lambert.  Grand challenges of information fusion , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[9]  James Zijun Wang,et al.  A Web service for efficient ontology comparison , 2005, IEEE International Conference on Web Services (ICWS'05).

[10]  Stuart A. Kauffman.  Understanding genetic regulatory networks , 2003 .

[11]  Arthur Stutt,et al.  Engineering Knowledge in the Age of the Semantic Web , 2004, Lecture Notes in Computer Science.

[12]  Masami Takikawa,et al.  Performance Evaluation for Automated Threat Detection , 2007, J. Adv. Inf. Fusion.

[13]  Alan N. Steinberg,et al.  Revisions to the JDL data fusion model , 1999, Defense, Security, and Sensing.

[14]  Lawrence J. Mazlack,et al.  Approximate Metrics for Autonomous Semantic Web Ontology Merging , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[15]  Dimitri P. Bertsekas,et al.  Auction algorithms for network flow problems: A tutorial introduction , 1992, Comput. Optim. Appl..

[16]  James Llinas,et al.  Revisiting the JDL Data Fusion Model II , 2004 .

[17]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[18]  David Sinclair,et al.  Mediating between heterogeneous ontologies using schema matching techniques , 2005, IRI -2005 IEEE International Conference on Information Reuse and Integration, Conf, 2005..

[19]  Changjun Jiang,et al.  GAOM: Genetic Algorithm Based Ontology Matching , 2006, 2006 IEEE Asia-Pacific Conference on Services Computing (APSCC'06).

[20]  Pedro M. Domingos,et al.  Learning to match ontologies on the Semantic Web , 2003, The VLDB Journal.

[21]  C. Nowak.  On ontologies for high-level information fusion , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[22]  Sameer Singh,et al.  Approaches to Multisensor Data Fusion in Target Tracking: A Survey , 2006, IEEE Transactions on Knowledge and Data Engineering.

[23]  Kathryn B. Laskey,et al.  Measuring Performance for Situation Assessment , 2001 .

[24]  B. Wang,et al.  Growing directed networks: organization and dynamics , 2004, cond-mat/0408391.

[25]  Dale Lambert,et al.  The Mephisto Conceptual Framework , 2008 .

[26]  Arantxa Etxeverria.  The Origins of Order , 1993 .