A controlled experiment with Usability Inspection Techniques applied to Use Case Specifications: comparing the MIT 1 and the UCE techniques

A Use Case Model is composed of use cases that describe software functionalities through Use Case Specifications. The evaluation of the specifications that compose such a model can allow for an early identification of usability defects. We previously proposed MIT 1-Model Inspection Technique for Usability Evaluation that aims to support the identification of usability defects through the evaluation of use cases specifications. In this paper, we present the evaluation of this technique through a controlled experiment that measured its efficiency, effectiveness, perceived ease of use, and perceived usefulness when compared to the Use Case Evaluation (UCE) method. Our quantitative findings indicate that MIT 1 allows users to find more usability defects in less time than UCE. However, UCE was considered easiest to use and more useful than MIT 1, highlighting improvement needs for MIT 1.

[1]  이훈,et al.  지각된 유용성(Perceived Usefulness)의 영향분석 , 2004 .

[2]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[3]  R. Johns,et al.  One Size Doesn’t Fit All: Selecting Response Scales For Attitude Items , 2005 .

[4]  Natalia Juristo Juzgado,et al.  A Glass Box Design: Making the Impact of Usability on Software Development Visible , 2007, INTERACT.

[5]  Tayana Conte,et al.  Evaluating an Inspection Technique for Use Case Specifications - Quantitative and Qualitative Analysis , 2015, ICEIS.

[6]  George M. Donahue.  Usability and the Bottom Line , 2001, IEEE Softw..

[7]  A. M. R. da Cruz.  Refining use cases through temporal relations , 2014, 2014 9th International Conference on Software Paradigm Trends (ICSOFT-PT).

[8]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[9]  Ven Yu Sien.  Teaching Object-Oriented Modelling using Concept Maps , 2010, Electron. Commun. Eur. Assoc. Softw. Sci. Technol..

[10]  Chris Sauer,et al.  Technical Reviews: A Behaviorally Motivated Program of Research , 2022 .

[11]  Tayana Conte,et al.  Integrating the Usability into the Software Development Process - A Systematic Mapping Study , 2015, ICEIS.

[12]  Forrest Shull,et al.  Building Knowledge through Families of Experiments , 1999, IEEE Trans. Software Eng..

[13]  Tayana Conte,et al.  Improving a Usability Inspection Technique Based on Quantitative and Qualitative Analysis , 2014, 2014 Brazilian Symposium on Software Engineering.

[14]  Silvia Mara Abrahão,et al.  Usability evaluation methods for the web: A systematic mapping study , 2011, Inf. Softw. Technol..

[15]  Jan Stage,et al.  Use Case Evaluation (UCE): A Method for Early Usability Evaluation in Software Development , 2007, INTERACT.

[16]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[17]  José Ambrosio Toval Álvarez,et al.  Integrating usability requirements that can be evaluated in design time into Model Driven Engineering of Web Information Systems , 2009, Adv. Eng. Softw..

[18]  Silvia Mara Abrahão,et al.  Usability Inspection in Model-Driven Web Development: Empirical Validation in WebML , 2013, MoDELS.

[19]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[20]  Silvia Mara Abrahão,et al.  Empirical validation of a usability inspection method for model-driven Web development , 2013, J. Syst. Softw..

[21]  Robert C. Williges,et al.  Criteria For Evaluating Usability Evaluation Methods , 2003, Int. J. Hum. Comput. Interact..

[22]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[23]  R. Garland.  The Mid-Point on a Rating Scale: Is it Desirable? , 1991 .

[24]  Filippo Lanubile,et al.  Tool support for geographically dispersed inspection teams , 2003, Softw. Process. Improv. Pract..

[25]  Kasper Hornbæk,et al.  Dogmas in the assessment of usability evaluation methods , 2010, Behav. Inf. Technol..

[26]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[27]  Colin Atkinson,et al.  An experimental comparison of reading techniques for defect detection in UML design documents , 2000, J. Syst. Softw..

[28]  Natalia Juristo Juzgado,et al.  Basics of Software Engineering Experimentation , 2010, Springer US.

[29]  Silvia Mara Abrahão,et al.  Further analysis on the validation of a usability inspection method for model-driven web development , 2012, Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement.

[30]  Natalia Juristo Juzgado,et al.  Usability basics for software developers , 2001, IEEE Software.

[31]  Jeffrey C. Carver,et al.  Issues in using students in empirical studies in software engineering education , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[32]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[33]  Filippo Lanubile,et al.  Can Real-Time Machine Translation Overcome Language Barriers in Distributed Requirements Engineering? , 2010, 2010 5th IEEE International Conference on Global Software Engineering.

[34]  Ahmed Seffah,et al.  The obstacles and myths of usability and software engineering , 2004, CACM.