Assessing the effectiveness of expert teams

The earliest literature concerning collective judgment consistently indicated that groupings of experts should be expected to outperform their average member, but there is little evidence available to suggest that the quality of collective judgment is substantially improved by any particular method of aggregation (Rohrbaugh, 1979, 1981). Fischer (1981) has concluded: From a practical standpoint it makes little or no difference how one aggregates the conflicting opinions of experts. Any reasonable approach is likely to be as good as any other.