An introduction to prior information derived from probabilistic judgements: elicitation of knowledge, cognitive bias and herding

Abstract Opinion of geological experts is often formed despite a paucity of data and is usually based on prior experience. In such situations humans employ heuristics (rules of thumb) to aid analysis and interpretation of data. As a result, future judgements are bootstrapped from, and hence biased by, both the heuristics employed and prior opinion. This paper reviews the causes of bias and error inherent in prior information derived from the probabilistic judgements of people. Parallels are developed between the evolution of scientific opinion on one hand and the limits on rational behaviour on the other. We show that the combination of data paucity and commonly employed heuristics can lead to herding behaviour within groups of experts. Elicitation theory mitigates the effects of such behaviour, but a method to estimate reliable uncertainties on expert judgements remains elusive. We have also identified several key directions in which future research is likely to lead to methods that reduce such emergent group behaviour, thereby increasing the probability that the stock of common knowledge will converge in a stable manner towards facts about the Earth as it really is. These include: (1) measuring the frequency with which different heuristics tend to be employed by experts within the geosciences; (2) developing geoscience-specific methods to reduce biases originating from the use of such heuristics; (3) creating methods to detect scientific herding behaviour; and (4) researching how best to reconcile opinions from multiple experts in order to obtain the best probabilistic description of an unknown, objective reality (in cases where one exists).