Observations on the Invalid Scoring Algorithm of "NASA" and Similar Consensus Tasks

The NASA ranking task and similar ranking activities used to demonstrate the superiority of group thinking are examined both analytically and by means of a computer simulation for fairness of the scoring algorithm. It is argued that the current scores cannot be used to prove the superiority of group-consensus decision making in either training or research settings. Recommendations are given for an improved modified scoring format and a discussion is presented concerning situations in which group consensus may not be desirable, based on the individual resources of the group members.