Comparing Interface Influence on Users with Varying Expertise

The design of a system interface can impact user judgements among expert and novice users alike. With information systems, fundamental design choices can either augment or distract individuals in identifying patterns of converging data points. The goal of this effort was to compare the influence of Likert and categorical type rating scales in a system used to guide analysts through a content analysis process. While these scales have been examined in the context of psychological assessment literature, little has been said about their impact on decision makers from a human computer interaction perspective. We conducted a laboratory experiment to explore the effect of using Likert and categorical scales in an intelligence assessment task using unstructured data. The dependent variables included (1) Likert versus categorical type scales and (2) analyst experience (novice versus expert). Results indicated that expert and novices both had greater confidence and more creative, accurate responses in the interface utilizing Likert decision scaling.