Heuristic evaluation of programming language features: two parallel programming case studies

Usability is an important feature for programming languages, and user evaluations can provide invaluable feedback on language design. However, user studies which compare programming languages or systems are often very expensive and typically inconclusive. In this paper, we posit that discount usability methods can be successfully applied to programming languages concepts such as language features. We give examples of useful feedback received from applying heuristic evaluation to two language features targeted at parallel programming.

[1]  Anind K. Dey,et al.  Heuristic evaluation of ambient displays , 2003, CHI '03.

[2]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[3]  Alan F. Blackwell,et al.  A Cognitive Dimensions questionnaire optimised for users , 2000, PPIG.

[4]  Ann L. Fruhling,et al.  Heuristic Evaluation of Mission-Critical Software Using a Large Team , 2009, HCI.

[5]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.

[6]  Yuanyuan Zhou,et al.  Learning from mistakes: a comprehensive study on real world concurrency bug characteristics , 2008, ASPLOS.

[7]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[8]  Cormac Flanagan,et al.  A type and effect system for atomicity , 2003, PLDI.

[9]  Bill Curtis,et al.  Applying Discount Usability Engineering , 1995, IEEE Softw..

[10]  Steven Clarke.  Evaluating a new programming language , 2001, PPIG.

[11]  Brad A. Myers,et al.  Using HCI techniques to design a more usable programming system , 2002, Proceedings IEEE 2002 Symposia on Human Centric Computing Languages and Environments.

[12]  Cormac Flanagan,et al.  Cooperative reasoning for preemptive execution , 2011, PPoPP '11.

[13]  James Demmel,et al.  the Parallel Computing Landscape , 2022 .

[14]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.

[15]  Margaret M. Burnett,et al.  Using cognitive dimensions: Advice from the trenches , 2006, J. Vis. Lang. Comput..

[16]  Simon L. Peyton Jones,et al.  A user-centred approach to functions in Excel , 2003, ICFP '03.

[17]  Cormac Flanagan,et al.  Effects for cooperable and serializable threads , 2010, TLDI '10.

[18]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[19]  Brad A. Myers,et al.  Usability Issues in the Design of Novice Programming Systems , 1996 .

[20]  David Kane,et al.  Finding a place for discount usability engineering in agile development: throwing down the gauntlet , 2003, Proceedings of the Agile Development Conference, 2003. ADC 2003.

[21]  Janet C. Read,et al.  Evidence Based Design of Heuristics for Computer Assisted Assessment , 2009, INTERACT.

[22]  Wayne D. Gray.  Discount Usability - Point: Who Ya Gonna Call? You're on Your Own , 1997, IEEE Software.

[23]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.