URREF reliability versus credibility in information fusion (STANAG 2511)

For many operational information fusion systems, both reliability and credibility are evaluation criteria for collected information. The Uncertainty Representation and Reasoning Evaluation Framework (URREF) is a comprehensive ontology that represents measures of uncertainty. URREF supports standards such as the NATO Standardization Agreement (STANAG) 2511, which incorporates categories of reliability and credibility. Reliability has traditionally been assessed for physical machines to support failure analysis. Source reliability of a human can also be assessed. Credibility is associated with a machine process or human assessment of collected evidence for information content. Other related constructs for URREF are data relevance and completeness. In this paper, we seek to develop a mathematical relation of weight of evidence using credibility and reliability as criteria for characterizing uncertainty in information fusion systems.

[1]  Erik Blasch,et al.  Level 5 (User Refinement) issues supporting Information Fusion Management , 2006, 2006 9th International Conference on Information Fusion.

[2]  Erik Blasch,et al.  Performance Measures of Covariance and Information Matrices in Resource Management for Target State Estimation , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Li Bai,et al.  Survivability - An information fusion process metric from an operational perspective , 2007, 2007 10th International Conference on Information Fusion.

[4]  Jigar Patel,et al.  A Trust and Reputation Model for Agent-Based Virtual Organisations , 2006 .

[5]  Erik Blasch,et al.  Minimum Error Bounded Efficient L1 Tracker with Occlusion Detection (PREPRINT) , 2011 .

[6]  Erik Blasch,et al.  Real-time vision-based tracking control of an unmanned vehicle , 1995 .

[7]  Ali Peiravi.  Reliability Prediction of Electronic Navigation and Guidance System Employing High Quality Parts to Achieve Increased Reliability , 2009 .

[8]  Erik Blasch,et al.  Situation, impact, and user refinement , 2003, SPIE Defense + Commercial Sensing.

[9]  Rong Pan,et al.  A Bayes approach to reliability prediction utilizing data from accelerated life tests and field failure observations , 2009, Qual. Reliab. Eng. Int..

[10]  Mani B. Srivastava,et al.  Building principles for a quality of information specification for sensor information , 2009, 2009 12th International Conference on Information Fusion.

[11]  Pierre Valin,et al.  Ontology alignment using relative entropy for semantic uncertainty analysis , 2010, Proceedings of the IEEE 2010 National Aerospace & Electronics Conference.

[12]  T. Denœux,et al.  Refined sensor tuning in the belief function framework using contextual discounting , 2006 .

[13]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[14]  Pierre Valin,et al.  Information fusion measures of effectiveness (MOE) for decision support , 2011, Defense + Commercial Sensing.

[15]  C. Yang,et al.  Pose angular-aiding for maneuvering target tracking , 2005, 2005 7th International Conference on Information Fusion.

[16]  Kathryn B. Laskey,et al.  Issues of Uncertainty Analysis in High-Level Information Fusion , 2012 .

[17]  E. Shahbazian,et al.  Uncertainty Evaluation: Current Status and Major Challenges , 2012 .

[18]  Erik Blasch,et al.  Sensor, User, Mission (SUM) Resource Management and Their Interaction with Level 2/3 Fusion , 2006, 2006 9th International Conference on Information Fusion.

[19]  S. Plano,et al.  DFIG level 5 (user refinement) issues supporting situational assessment reasoning , 2005, 2005 7th International Conference on Information Fusion.

[20]  Chun Yang,et al.  Kalman Filtering with Nonlinear State Constraints , 2009 .

[21]  Yufeng Zheng,et al.  Qualitative and quantitative comparisons of multispectral night vision colorization techniques , 2012, Optical Engineering.

[22]  Erik Blasch,et al.  Fusion of Distributions for Radar Clutter Modeling , 2004 .

[23]  James Llinas,et al.  High Level Information Fusion (HLIF): Survey of models, issues, and grand challenges , 2012, IEEE Aerospace and Electronic Systems Magazine.

[24]  Jean Dezert,et al.  General Combination Rules for Qualitative and Quantitative Beliefs , 2008, J. Adv. Inf. Fusion.

[25]  Jose B. Cruz,et al.  Game Theoretic Approach to Threat Prediction and Situation Awareness , 2006, 2006 9th International Conference on Information Fusion.

[26]  Erik Blasch,et al.  Information fusion for information superiority , 2000, Proceedings of the IEEE 2000 National Aerospace and Electronics Conference. NAECON 2000. Engineering Tomorrow (Cat. No.00CH37093).

[27]  Gary Johnson,et al.  A Decision Making Framework for Sediment Assessment Developed for the Great Lakes , 2002 .

[28]  Ondrej Straka,et al.  Multitarget tracking performance analysis using the non-credibility index in the Nonlinear Estimation Framework (NEF) toolbox , 2010, Proceedings of the IEEE 2010 National Aerospace & Electronics Conference.

[29]  Jean Dezert,et al.  Target Type Tracking with PCR5 and Dempster's rules: A Comparative Analysis , 2006, 2006 9th International Conference on Information Fusion.

[30]  John J. Salerno,et al.  Evaluating algorithmic techniques in supporting situation awareness , 2005, SPIE Defense + Commercial Sensing.

[31]  James P. Delgrande,et al.  A Formal Analysis of Relevance , 1998 .

[32]  James Llinas.  Assessing the Performance of Multisensor Fusion Processes , 2001 .

[33]  P. Li,et al.  LAND COVER CLASSIFICATION OF MULTI-SENSOR IMAGES BY DECISION FUSION USING WEIGHTS OF EVIDENCE MODEL , 2012 .

[34]  Li Bai,et al.  Real-Time Probabilistic Covariance Tracking With Efficient Model Update , 2012, IEEE Transactions on Image Processing.

[35]  David L. Hall,et al.  Assessing the Performance of Multisensor Fusion Processes , 2001 .

[36]  Sheldon Krimsky,et al.  The weight of scientific evidence in policy and law. , 2005, American journal of public health.

[37]  Erik Blasch,et al.  Towards unbiased evaluation of uncertainty reasoning: The URREF ontology , 2012, 2012 15th International Conference on Information Fusion.

[38]  Paulo Cesar G. da Costa,et al.  Evaluating uncertainty representation and reasoning in HLF systems , 2011, 14th International Conference on Information Fusion.

[39]  P. Smets,et al.  Assessing sensor reliability for multisensor data fusion within the transferable belief model , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  Jean Dezert,et al.  UNM Digital Repository UNM Digital Repository Fusion of Sources of Evidence with Different Importances and Fusion of Sources of Evidence with Different Importances and Reliabilities Reliabilities , 2022 .

[41]  Erik Blasch,et al.  Measures of effectiveness for high-level fusion , 2010, 2010 13th International Conference on Information Fusion.

[42]  Erik P. Blasch,et al.  Fusion metrics for dynamic situation analysis , 2004, SPIE Defense + Commercial Sensing.

[43]  Florentin Smarandache,et al.  Advances and Applications of DSmT for Information Fusion (Collected Works) , 2004 .

[44]  Genshe Chen,et al.  Game Theoretic Solutions to Cyber Attack and Network Defense Problems , 2007 .

[45]  Li Bai,et al.  Two-Way Handshaking Circular Sequential $k$-Out-of- $n$ Congestion System , 2008, IEEE Transactions on Reliability.

[46]  Pierre Valin,et al.  DSmT applied to seismic and acoustic sensor fusion , 2011, Proceedings of the 2011 IEEE National Aerospace and Electronics Conference (NAECON).

[47]  T. Bass,et al.  Defense-in-depth revisited: qualitative risk analysis methodology for complex network-centric operations , 2001, 2001 MILCOM Proceedings Communications for Network-Centric Operations: Creating the Information Force (Cat. No.01CH37277).

[48]  Ronald R. Yager.  Prioritized aggregation operators and their applications , 2012, 2012 6th IEEE International Conference Intelligent Systems.

[49]  Paulo Cesar G. da Costa,et al.  High-level fusion: Issues in developing a formal theory , 2010, 2010 13th International Conference on Information Fusion.

[50]  Adrien Revault d'Allonnes,et al.  An extension of STANAG2022 for information scoring , 2008, 2008 11th International Conference on Information Fusion.

[51]  I. Kadar,et al.  Resource management coordination with level 2/3 fusion issues and challenges [Panel Report] , 2008, IEEE Aerospace and Electronic Systems Magazine.

[52]  Robert R. Tenney,et al.  Dynamic tactical targeting , 2004, SPIE Defense + Commercial Sensing.

[53]  Miroslav Simandl,et al.  Active fault detection and control: Unified formulation and optimal design , 2009, Autom..

[54]  Li Bai,et al.  Multiple source data fusion via sparse representation for robust visual tracking , 2011, 14th International Conference on Information Fusion.

[55]  Minfeng Deng,et al.  A Conditional Dependence Adjusted Weights of Evidence Model , 2009 .

[56]  Igor Linkov,et al.  Use of Multicriteria Decision Analysis to Support Weight of Evidence Evaluation , 2011, Risk analysis : an official publication of the Society for Risk Analysis.

[57]  Eloi Bosse,et al.  High-Level Information Fusion Management and System Design , 2012 .

[58]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Carl S. Byington,et al.  Data Fusion for Developing Predictive Diagnostics for Electromechanical Systems , 2001 .

[60]  Erik Blasch,et al.  JDL level 5 fusion model: user refinement issues and applications in group tracking , 2002, SPIE Defense + Commercial Sensing.

[61]  E.P. Blasch,et al.  Derivation of a Reliability Metric for Fused Data Decision Making , 2008, 2008 IEEE National Aerospace and Electronics Conference.

[62]  Peter Gärdenfors.  On the logic of relevance , 1978 .

[63]  Pia Borlund,et al.  The concept of relevance in IR , 2003, J. Assoc. Inf. Sci. Technol..

[64]  Erik Blasch,et al.  Unmanned vehicles come of age: The DARPA grand challenge , 2006, Computer.

[65]  Vincent Nimier.  Information Evaluation : a formalisation of operational recommandations , 2004 .

[66]  Genshe Chen,et al.  Strategies comparison for game theoretic cyber situational awareness and impact assessment , 2007, 2007 10th International Conference on Information Fusion.

[67]  Erik Blasch,et al.  Ontological issues in higher levels of information fusion: user refinement of the fusion process , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[68]  Erik Blasch,et al.  Decision-Level Fusion Performance Improvement From Enhanced HRR Radar Clutter Suppression , 2011, J. Adv. Inf. Fusion.

[69]  D. Weed.  Weight of Evidence: A Review of Concept and Methods , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[70]  Ronald R. Yager,et al.  Prioritized aggregation operators , 2008, Int. J. Approx. Reason..

[71]  Erik Blasch,et al.  Issues and Challenges in Situation Assessment (Level 2 Fusion) , 2006, J. Adv. Inf. Fusion.

[72]  G. Smith,et al.  Reliability modeling for systems requiring mission reconfigurability , 1990, Annual Proceedings on Reliability and Maintainability Symposium.