Abstract : Full validation of a model involves a number of steps. The first is to ensure that the model represents the required domain adequately (content validation). The second is to ensure that the principles underlying the model make reasonable use of current understanding of the problem space (construct validity). If the model meets these two criteria there is a requirement that the predictions of the model represent what happens in the real world to an adequate degree (predictive validity). The predictive validity of models that characterise human physiological response or low level human physical and cognitive performance can be conducted using statistical tools suitable for the analysis of interval data such as analysis of variance. When a model is developed that describes choice of course of action, an important element of human behavioural modelling, the outcomes are necessarily discrete and the volume of data available for analysis is typically smaller than desirable for validation over a broad scope. Any stream of similar decisions in a military context is likely to be aimed at maintaining the real world outcome close to a desired profile drawn up at the planning stage. In this way the process of taking decisions and monitoring their implementation is analogous to the process of tracking, embodied in such activities as driving a vehicle. The approach is applied directly to a tracking task to illustrate the interaction between a stream of decisions and outcomes and the problems of generalising the approach to more complex situations is discussed.
[1]
Benefits for Environmental Decisions,et al.
Commission On Behavioral and Social Sciences And Education
,
1990
.
[2]
Andrew J Belyavin,et al.
Modeling performance and alertness: the QinetiQ approach.
,
2004,
Aviation, space, and environmental medicine.
[3]
Gwendolyn E. Campbell,et al.
HBR Validation: Integrating Lessons Learned From Multiple Academic Disciplines, Applied Communities, and the AMBR Project
,
2006
.
[4]
R. Yerkes,et al.
The relation of strength of stimulus to rapidity of habit‐formation
,
1908
.
[5]
William M. K. Trochim,et al.
Research methods knowledge base
,
2001
.
[6]
D. Kleinman,et al.
An optimal control model of human response part II: Prediction of human performance in a complex task
,
1970
.
[7]
Richard W. Pew,et al.
Modeling Human and Organizational Behavior
,
1998
.
[8]
Kevin M. Corker,et al.
Human Performance Models of Pilot Behavior
,
2005
.
[9]
John A. Nelder,et al.
A Simplex Method for Function Minimization
,
1965,
Comput. J..
[10]
L. Cronbach,et al.
Construct validity in psychological tests.
,
1955,
Psychological bulletin.
[11]
Andrew Belyavin,et al.
A discrete event controller as a model of pilot control behavior
,
2009
.