Evaluation of software usability using scenarios organized by abstraction structure

Motivation -- To improve the current practice of scenario-based usability evaluation by suggesting a new method for generating more comprehensive scenarios and using the scenarios more easily and systematically. Research approach -- Work domain analysis (WDA) concept in cognitive work analysis (CWA) framework was employed to develop a method for identifying functions and their relationships, which need to be reflected in scenarios. Two methodological tools were developed to help evaluators analyze functional structure and generate meaningful scenarios respectively. Findings/Design -- A new method for generating and using scenarios was developed, which accompanies two new tools (function-control matrix and function order diagram). Research limitations/Implications -- As the method was applied to only one word processing software, there is a lack of case studies; however, the method has features that may be generalized to other kinds of software. Originality/Value -- This research contributes to making a scenario-based evaluation process more systematic by supplementing its current weak points. Also this research applied abstraction hierarchy concept to software systems to which little attention has been given. Take away message -- Scenario-based usability evaluation can be enriched with the use of abstraction-based functional structure of software.