New perspectives on level-5 information fusion: The impact of advances in information technology and user behavior

The Joint Directors of Laboratories (JDL) data fusion process model, originally introduced in 1991, defined four levels of information fusion functions to transform sensor data into usable information for analysts. In 2000, M. J. Hall, S.A. Hall and T. Tate [1] introduced the concept of a 5th-level of fusion processing to recognize the need for providing an intelligent interaction with system users. Since that time, significant advances have been made in information technology, behavioral changes in users, and new concepts in the role of the human in information fusion systems. This paper presents a review of these changes and perspectives on the evolution of the JDL level-5 process.

[1]  Clay Shirky,et al.  Cognitive Surplus: Creativity and Generosity in a Connected Age , 2010 .

[2]  Michael D. McNeese,et al.  New visions of human-computer interaction: making affect compute , 2003, Int. J. Hum. Comput. Stud..

[3]  Jake Graham,et al.  Empowering the Next-Generation Analyst , 2016 .

[4]  David L. Hall,et al.  Perspectives on visualization and virtual world technologies for multi-sensor data fusion , 2008, 2008 11th International Conference on Information Fusion.

[5]  John Yen,et al.  Collaborative RPD Agents Assisting Decision Making in Active Decision Spaces , 2006, 2006 IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[6]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[7]  James Llinas,et al.  Multisensor Data Fusion , 1990 .

[8]  J. Palfrey,et al.  Born digital: understanding the first generation of digital natives , 2009, Choice Reviews Online.

[9]  Mike Hall,et al.  Cooperative use of unmanned sea surface and micro aerial vehicles at Hurricane Wilma , 2008, J. Field Robotics.

[10]  Michael D. McNeese,et al.  NeoCITIES: A Simulated Command and Control Task Environment for Experimental Research , 2010 .

[11]  M. Hansen,et al.  Participatory Sensing , 2019, Internet of Things.

[12]  D. L. Hall.  Intelligent Monitoring of Complex Systems , 2002 .

[13]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[14]  Michael D. McNeese,et al.  Conserving analyst attention units: use of multi-agent software and CEP methods to assist information analysis , 2013, Defense, Security, and Sensing.

[15]  Sonya A. H. McMullen,et al.  Mathematical Techniques in Multisensor Data Fusion (Artech House Information Warfare Library) , 2004 .

[16]  J. Hayden.  Cognitive Surplus: Creativity and Generosity in a Connected Age , 2011 .

[17]  David L. Hall,et al.  Human-Centered Information Fusion: Artech House Electronic Warfare Library , 2010 .

[18]  John M. Flach,et al.  5 – Information Processing , 1988 .

[19]  Andy Slovak,et al.  Introduction to Ergonomics , 2011 .

[20]  Luca Petricca,et al.  Micro- and Nano-Air Vehicles: State of the Art , 2011 .

[21]  David C. Nagel,et al.  Human factors in aviation , 1988 .

[22]  Erik Blasch,et al.  JDL level 5 fusion model: user refinement issues and applications in group tracking , 2002, SPIE Defense + Commercial Sensing.

[23]  Nicklaus A. Giacobe,et al.  Songs of cyberspace: an update on sonifications of network traffic to support situational awareness , 2011, Defense + Commercial Sensing.

[24]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[25]  Alan N. Steinberg,et al.  Revisions to the JDL data fusion model , 1999, Defense, Security, and Sensing.

[26]  T. D. Wilson.  Review of: Shirky, Clay. Cognitive surplus: creativity and generosity in a connected age. London: Allen Lane, Penguin Books, 2010 , 2011, Inf. Res..

[27]  V. Ramachandran,et al.  Synaesthesia? A window into perception, thought and language , 2001 .

[28]  David L. Hall,et al.  Perspectives on the Human Side of Data Fusion: Prospects for Improved Effectiveness Using Advanced Human–Computer Interfaces , 2017 .

[29]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[30]  Nicklaus A. Giacobe,et al.  Application of the JDL data fusion process model for cyber security , 2010, Defense + Commercial Sensing.

[31]  Jie Lu,et al.  A Situation Analysis Decision Support System Based on Dynamic Object Oriented Bayesian Networks , 2014, J. Softw..

[32]  Andrew Ball,et al.  Decisions in condition monitoring-an examplar for data fusion architecture , 2000, Proceedings of the Third International Conference on Information Fusion.

[33]  Vincent Francis Mancuso,et al.  An interdisciplinary evaluation of transactive memory in distributed cyber teams , 2012 .

[34]  Wilmuth Müller,et al.  Integrating Persistent Surveillance Systems into ISR Architecture , 2012, Future Security.

[35]  John Yen,et al.  RPD-enabled agents teaming with humans for multi-context decision making , 2006, AAMAS '06.

[36]  Mary Jane Hall,et al.  Removing the HCI Bottleneck: How the Human-Computer Interface (HCI) Affects the Performance of Data Fusion Systems* , 2001 .

[37]  Pramod K. Varshney,et al.  Multisensor Data Fusion , 1997, IEA/AIE.

[38]  ศุภกร จูฑะพล.  Grown Up Digital , 2015 .

[39]  N. Nwiabu,et al.  Case-based situation awareness , 2012, 2012 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support.

[40]  Federico Castanedo,et al.  A Review of Data Fusion Techniques , 2013, TheScientificWorldJournal.

[41]  L. C. Jain,et al.  Advances in Intelligent Systems for Defence , 2002 .

[42]  James Llinas,et al.  Belief-based hybrid argumentation for threat assessment , 2015, 2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision.