Towards unbiased evaluation of uncertainty reasoning: The URREF ontology

Current advances in technology, sensor collection, data storage, and data distribution have afforded more complex, distributed, and operational information fusion systems (IFSs). IFSs notionally consist of low-level (data collection, registration, and association in time and space) and high-level information fusion (user coordination, situational awareness, and mission control), which require a common ontology for effective communication and data processing. In this paper, we describe the ontology reference model developed as part of the uncertainty representation and reasoning evaluation framework (URREF). The URREF ontology is intended to provide guidance for defining the actual concepts and criteria that together comprise the comprehensive uncertainty evaluation framework being developed by the Evaluation of Technologies for Uncertainty Representation Working Group (ETURWG).

[1]  K.C. Chang,et al.  Quality of information for data fusion in net centric publish and subscribe architectures , 2005, 2005 7th International Conference on Information Fusion.

[2]  Erik Blasch,et al.  User information fusion decision making analysis with the C-OODA model , 2011, 14th International Conference on Information Fusion.

[3]  Pierre Valin,et al.  Analysis of information fusion combining rules under the dsm theory using ESM inputs , 2007, 2007 10th International Conference on Information Fusion.

[4]  David L. Hall,et al.  Assessing the Performance of Multisensor Fusion Processes , 2001 .

[5]  Pradeep K. Atrey,et al.  Modeling Quality of Information in Multi-sensor Surveillance Systems , 2007, 2007 IEEE 23rd International Conference on Data Engineering Workshop.

[6]  D. Schum.  The Evidential Foundations of Probabilistic Reasoning , 1994 .

[7]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[8]  Erik Blasch,et al.  Issues and Challenges in Situation Assessment (Level 2 Fusion) , 2006, J. Adv. Inf. Fusion.

[9]  Eloi Bosse,et al.  High-Level Information Fusion Management and System Design , 2012 .

[10]  Paulo Cesar G. da Costa,et al.  High-level fusion: Issues in developing a formal theory , 2010, 2010 13th International Conference on Information Fusion.

[11]  Robert R. Tenney,et al.  Dynamic tactical targeting , 2004, SPIE Defense + Commercial Sensing.

[12]  James Llinas,et al.  Revisiting the JDL Data Fusion Model II , 2004 .

[13]  L.J.H.M. Kester,et al.  On measures of performance to assess sensor fusion effectiveness , 2000, Proceedings of the Third International Conference on Information Fusion.

[14]  Zhi Tian,et al.  MAP track fusion performance evaluation , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[15]  Erik Blasch,et al.  Information fusion for information superiority , 2000, Proceedings of the IEEE 2000 National Aerospace and Electronics Conference. NAECON 2000. Engineering Tomorrow (Cat. No.00CH37093).

[16]  Paulo Cesar G. da Costa,et al.  Evaluating uncertainty representation and reasoning in HLF systems , 2011, 14th International Conference on Information Fusion.

[17]  Rudolf Kruse,et al.  Fusion: General concepts and characteristics , 2001, Int. J. Intell. Syst..

[18]  P. Walley.  Measures of Uncertainty in Expert Systems , 1996, Artificial Intelligence.

[19]  Bin Yu,et al.  Learning the Quality of Sensor Data in Distributed Decision Fusion , 2006, 2006 9th International Conference on Information Fusion.

[20]  Erik P. Blasch,et al.  Fusion metrics for dynamic situation analysis , 2004, SPIE Defense + Commercial Sensing.

[21]  D. A. Lambert.  Situations for situation awareness , 2001 .

[22]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[23]  Erik Blasch,et al.  Measures of effectiveness for high-level fusion , 2010, 2010 13th International Conference on Information Fusion.

[24]  James Llinas.  Assessing the Performance of Multisensor Fusion Processes , 2001 .

[25]  Joeri van Laere,et al.  Challenges for IF performance evaluation in practice , 2009, 2009 12th International Conference on Information Fusion.

[26]  Peter Walley,et al.  Measures of Uncertainty in Expert Systems , 1996, Artif. Intell..

[27]  Eloi Bosse,et al.  Information quality effects on information fusion , 2008 .

[28]  Jean Roy,et al.  Expression of uncertainty in linguistic data , 2008, 2008 11th International Conference on Information Fusion.

[29]  Mani B. Srivastava,et al.  Building principles for a quality of information specification for sensor information , 2009, 2009 12th International Conference on Information Fusion.

[30]  Walter L. Perry,et al.  EXPLORING INFORMATION SUPERIORITY A Methodology for Measuring the Quality of Information and Its Impact on Shared Awareness , 2004 .