Classification of Usability Problems (CUP) Scheme

Defect classification can improve product quality and motivate process improvement. Several defect classification schemes have been developed and used with good results in software development. This paper describes the design and test of a defect classification scheme that specifically extracts information from usability problems. We describe the attributes of the defects, the attribute values, including the phases of user interface development. We have tested the classification scheme on defects that were found during heuristic evaluation and user test of software that implements a broker for exchange of on line learning resources. The paper presents results of the classifications and assesses the repeatability of the defect classification scheme. We show how developers, project manager, and process engineers can use information from the defect classification for improvement of the user interface, personal skills and training, and process improvement.

[1]  Robert G. Mays,et al.  Experiences with Defect Prevention , 1990, IBM Syst. J..

[2]  Inderpal S. Bhandari,et al.  Orthogonal Defect Classification - A Concept for In-Process Measurements , 1992, IEEE Trans. Software Eng..

[3]  Norm Bridge,et al.  Orthogonal Defect Classification Using Defect Data to Improve Software Development , 1998 .

[4]  Dewayne E. Perry,et al.  A case study in root cause defect analysis , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[5]  Robert B. Grady,et al.  Practical Software Metrics for Project Management and Process Improvement , 1992 .

[6]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[7]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[8]  Ebba Þóra Hvannberg,et al.  Basic concepts , 2020, Fluid Flow in Porous Media.

[9]  Khaled El Emam,et al.  The repeatability of code defect classifications , 1998, Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257).

[10]  Diane Kelly,et al.  A case study in the use of defect classification in inspections , 2001, CASCON.

[11]  Jakob Nielsen,et al.  Improving a human-computer dialogue , 1990, CACM.

[12]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[13]  Bernd G. Freimut Developing and using defect classification schemes , 2001 .

[14]  Adam A. Porter,et al.  Comparing Detection Methods for Software Requirements Inspections: A Replicated Experiment , 1995, IEEE Trans. Software Eng..

[15]  Michael Fredericks,et al.  Using Defect Tracking and Analysis to Improve Software Quality , 1999 .

[16]  David N. Card,et al.  Learning from Our Mistakes with Defect Causal Analysis , 1999, IEEE Softw..