When a better interface and easy navigation aren't enough: Examining the information architecture in a law enforcement agency

An information architecture that allows users to easily navigate through a system and quickly recover from mistakes is often defined as a highly usable system. But usability in systems design goes beyond a good interface and efficient navigation. In this article we describe two database systems in a law enforcement agency. One system is a legacy, text-based system with cumbersome navigation (RMS); the newer system is a graphical user interface with simplified navigation (CopNet). It is hypothesized that law enforcement users will evaluate CopNet higher than RMS, but experts of the older system will evaluate it higher than others will. We conducted two user studies. One study examined what users thought of RMS and CopNet, and compared RMS experts' evaluations with nonexperts. We found that all users evaluated CopNet as more effective, easier to use, and easier to navigate than RMS, and this was especially noticeable for users who were not experts with the older system. The second, follow-up study examined use behavior after CopNet was deployed some time later. The findings revealed that evaluations of CopNet were not associated with its use. If the newer system had a better interface and was easier to navigate than the older, legacy system, why were law enforcement personnel reluctant to switch? We discuss reasons why switching to a new system is difficult, especially for those who are most adept at using the older system. Implications for system design and usability are also discussed.

[1]  Gavriel Salvendy,et al.  A proposed index of usability: A method for comparing the relative usability of different software systems , 1997, Behav. Inf. Technol..

[2]  R. Kraut,et al.  Varieties of Social Influence: the Role of Utility and Norms in the Success of a New Communication Medium , 1998 .

[3]  Michael R. Vitale,et al.  Creating Competitive Advantage with Interorganizational Information Systems , 1988, MIS Q..

[4]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[5]  Michael D. Maltz,et al.  Mapping Crime in Its Community Setting: Event Geography Analysis , 1990 .

[6]  Andrew Dillon,et al.  Expertise and the Perception of Shape in Information , 1996, J. Am. Soc. Inf. Sci..

[7]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[8]  Kenneth L. Kraemer,et al.  Computerized Data-Based Systems and Productivity among Professional Workers: The Case of Detectives , 1985 .

[9]  Bonnie A. Nardi,et al.  Information Ecologies: Using Technology with Heart , 1999 .

[10]  George W. Furnas,et al.  Effective view navigation , 1997, CHI.

[11]  Bruce Rocheleau,et al.  Evaluating public sector information systems: Satisfaction versus impact , 1993 .

[12]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[13]  Louis M. Gomez,et al.  No IFs, ANDs, or ORs: A Study of Database Querying , 1990, Int. J. Man Mach. Stud..

[14]  Les Gasser,et al.  The integration of computing and routine work , 1986, TOIS.

[15]  Kari Thoreson,et al.  Simple, but cumbersome , 1997, DIS '97.

[16]  Matthias Rauterberg,et al.  An empirical comparison of menu-selection (CUI) and desktop (GUI) computer programs carried out by beginners and experts , 1992 .

[17]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[18]  Stuart K. Card,et al.  Information foraging in information access environments , 1995, CHI '95.

[19]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[20]  Andrew Dillon,et al.  User analysis in HCI - the historical lessons from individual differences research , 1996, Int. J. Hum. Comput. Stud..

[21]  Louis M. Gomez,et al.  A Cognitive Analysis of Database Query Production , 1986 .

[22]  Michael D. Maltz,et al.  Mapping Crime in Its Community Setting , 1991 .