Rule identification is proposed as an alternative to parameter estimation in the analysis of human performanc data. The relation between the choice of language and identifiable consistencies is discussed. Advantages of production system models for the description of complex human behaviors are examined. Threats to validity posed by the use of flexible languages in data analysis are examined. Contrivedness, defined by Eilbert and Christensen 82) as, “ the tendency of a search procedure to uncover apparent patterns where none exist”, is advanced as the major inferential hazard to rule identification. A Monte Carlo significance testing procedure to deal with this threat is proposed. Nonparametric measures of relation, tau-b and PRE, are presented as appropriate performance measures for rule-based models. A rule-based analysis of data from an experiment (Palmer, 1983) involving pilot decisions in air traffic conflicts is presented. Identified rules indicate satisficing with respect to the secondary goal of maintaining a constant course. Reduction in dimensionality of utilized information led to errors for a subgroup of pilots.
[1]
Everett Palmer.
Conflict Resolution Maneuvers during near Miss Encounters with Cockpit Traffic Displays
,
1983
.
[2]
Barry H. Margolin,et al.
An Analysis of Variance for Categorical Data, II: Small Sample Comparisons with Chi Square and other Competitors
,
1974
.
[3]
Robert B. Wesson.
Planning in the World of the Air Traffic Controller
,
1977,
IJCAI.
[4]
Ronald A. Christensen,et al.
Contrivedness: The boundary between pattern recognition and numerology
,
1982,
Pattern Recognit..
[5]
Tom M. Mitchell,et al.
Version Spaces: A Candidate Elimination Approach to Rule Learning
,
1977,
IJCAI.
[6]
William B. Rouse,et al.
A fuzzy rule-based model of human problem solving
,
1982,
IEEE Transactions on Systems, Man, and Cybernetics.
[7]
Alan B. Forsythe,et al.
A Stopping Rule for Variable Selection in Multiple Regression
,
1973
.