Usability of voting systems: baseline data for paper, punch cards, and lever machines

In the United States, computer-based voting machines are rapidly replacing other older technologies. While there is potential for this to be a usability improvement, particularly in terms of accessibility, the only way it is possible to know if usability has improved is to have baseline data on the usability of traditional technologies. We report an experiment assessing the usability of punch cards, lever machines, and two forms of paper ballot. There were no differences in ballot completion time between the four methods, but there were substantial effects on error rate, with the paper ballots superior to the other methods as well as an interaction with age of voters. Subjective usability was assessed with the System Usability Scale and showed a slight advantage for bubble-style paper ballots. Overall, paper ballots were found to be particularly usable, which raises important technological and policy issues.

[1]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[2]  Michael D. Byrne,et al.  A Comparison of Usability Between Voting Methods , 2006, EVT.

[3]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[4]  Stephen Ansolabehere,et al.  Residual Votes Attributable to Technology , 2005, The Journal of Politics.

[5]  Erik Frekjmr,et al.  Measuring Usability: Are Effectiveness, Efficiency, and Satisfaction Really Correlated? , 2000 .

[6]  Michael D. Byrne,et al.  Measuring the Usability of Paper Ballots: Efficiency, Effectiveness, and Satisfaction , 2006 .

[7]  Abigail Sellen,et al.  The myth of the paperless office , 2001 .

[8]  Delbert A. Taebel The Effect of Ballot Position on Electoral Success , 1975 .

[9]  Jean Scholtz,et al.  Common industry format for usability test reports , 2000, CHI Extended Abstracts.

[10]  David C. Kimball,et al.  Ballot Design and Unrecorded Votes on Paper-Based Ballots , 2005 .

[11]  S. Laskowski,et al.  Improving the Usability and Accessibility of Voting Systems and Products | NIST , 2004 .

[12]  Bongshin Lee,et al.  Electronic voting system usability issues , 2003, CHI '03.

[13]  Jonathan N. Wand,et al.  The Butterfly Did It: The Aberrant Vote for Buchanan in Palm Beach County, Florida , 2001, American Political Science Review.

[14]  Dan S. Wallach,et al.  Analysis of an electronic voting system , 2004, IEEE Symposium on Security and Privacy, 2004. Proceedings. 2004.

[15]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[16]  Walter R. Mebane,et al.  The Wrong Man is President! Overvotes in the 2000 Presidential Election in Florida , 2004, Perspectives on Politics.