Evaluating design specifications using heuristic evaluation

A study was carried out to examine the value of evaluating designs by applying heuristic evaluation to written design specifications. Whilst experienced and novice usability specialists did not differ in the evaluation of a telephone interface, they differed in the evaluation of a screen-based interface. Protocol analysis suggested that experienced usability specialists were able to utilized knowledge of previous user testing results and knowledge of similar designs to identify problems which were missed by novices. Ways to improve novices’ ability to pick out problems from design specifications are suggested.