JDL level 5 fusion model: user refinement issues and applications in group tracking

The 1999 Joint Director of Labs (JDL) revised model incorporates five levels for fusion methodologies including level 0 for preprocessing, level 1 for object refinement, level 2 for situation refinement, level 3 for threat refinement, and level 4 for process refinement. The model was developed to define the fusion process. However, the model is only for automatic processing of a machine and does not account for human processing. Typically, a fusion architecture supports a user and thus, we propose a Level 5 User refinement to delineate the human from the machine in the process refinement. Typical human in the loop models do not deal with a machine fusion process, but only present the information to the human on a display. We seek to address issues for designing a fusion system which supports a user: trust, workload, attention and situation awareness. In this paper, we overview the need for a Level 5, the issues concerning the human for realizable fusion architectures, and examples where the human is instrumental in the fusion process such as group tracking.

[1]  R. Näätänen.  Attention and brain function , 1992 .

[2]  Ann M. Bisantz,et al.  Assessment of operator trust in and utilization of automated decision-aids under different framing conditions , 2001 .

[3]  Alan N. Steinberg,et al.  Revisions to the JDL data fusion model , 1999, Defense, Security, and Sensing.

[4]  G. Woodman,et al.  Visual Search Remains Efficient when Visual Working Memory is Full , 2001, Psychological science.

[5]  Kip Smith,et al.  Situational Awareness in Complex Systems , 1994 .

[6]  Ruxandra Sireteanu,et al.  Perceptual learning in visual search generalizes over tasks, locations, and eyes , 2000, Vision Research.

[7]  Erik Blasch,et al.  Physio-associative temporal sensor integration , 1998, Defense, Security, and Sensing.

[8]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[9]  Bonnie M. Muir,et al.  Trust in automation. I: Theoretical issues in the study of trust and human intervention in automated systems , 1994 .

[10]  Jason Moore,et al.  Interactive displays for command and control , 2000, 2000 IEEE Aerospace Conference. Proceedings (Cat. No.00TH8484).

[11]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[12]  R. Mayer.  Thinking, Problem Solving, Cognition , 1983 .

[13]  Ivan Kadar,et al.  Perceptual reasoning in adaptive fusion processing , 2002, SPIE Defense + Commercial Sensing.

[14]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[15]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[16]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[17]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[18]  Michael Isard,et al.  Active Contours: The Application of Techniques from Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion , 2000 .

[19]  Mica R. Endsley,et al.  The Application of Human Factors to the Development of Expert Systems for Advanced Cockpits , 1987 .

[20]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[21]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[22]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[23]  P. G. Raeth,et al.  Transitioning basic research to build a dynamic model of pilot trust and workload allocation , 1999 .

[24]  M. Bedworth,et al.  The Omnibus model: a new model of data fusion? , 2000 .

[25]  David B. Kaber,et al.  Design of Automation for Telerobots and the Effect on Performance, Operator Situation Awareness, and Subjective Workload , 2000 .

[26]  Jens Rasmussen,et al.  Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering , 1986 .

[27]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .