Exploratory usability evaluation of the capability-design tool

There is currently increasing interest in the application of usability evaluation approaches in modelling tools. Tools are the main technical resource for creating and managing models and also for specifying and using modelling languages. This usability not only takes into account the easy interaction of the users with the tool, it also takes into account specific expectations of the users of the model-driven initiatives, which are related to operations on models. This work presents a usability evaluation process that was applied on the Capability Design Tool (CDT) of the CaaS EU project. This tool allows enterprise modelling to be done using an adapted version of the 4EM modelling language and the Capability-driven development (CDD) methodology. It was demonstrated that non-technological approaches for usability testing have detected more usability issues regarding eye-trackers since these approaches allow the expectations of the users of the tool to be contrasted with the associated modelling methodology.

[1]  Barbara Weber,et al.  Eye Tracking Meets the Process of Process Modeling: A Visual Analytic Approach , 2016, Business Process Management Workshops.

[2]  Jürgen Dingel,et al.  The problems with eclipse modeling tools: a topic analysis of eclipse forums , 2016, MoDELS.

[3]  ISO / IEC 25010 : 2011 Systems and software engineering — Systems and software Quality Requirements and Evaluation ( SQuaRE ) — System and software quality models , 2013 .

[4]  Oscar Pastor,et al.  Continuous Validation of a Modelling Tool in an Industrial Setting , 2016, 2016 IEEE/ACM 4th International Workshop on Conducting Empirical Studies in Industry (CESI).

[5]  Håkan Burden,et al.  Industrial Adoption of Model-Driven Engineering: Are the Tools Really the Problem? , 2013, MoDELS.

[6]  Pierre Boulet,et al.  Evaluation of Modeling Tools Adaptation , 2012 .

[7]  Adelinde M. Uhrmacher,et al.  Evaluating different modeling languages based on a user study , 2016, SpringSim.

[8]  Manuel Jiménez Buendía,et al.  Habitation: A Domain-Specific Language for Home Automation , 2009, IEEE Software.

[9]  Richard Berntsson-Svensson,et al.  Addressing model complexity in automotive system development: Selection of system model elements for allocation of requirements , 2016, 2016 4th International Conference on Model-Driven Engineering and Software Development (MODELSWARD).

[10]  Oscar Pastor.  A Capability-Driven Development Approach for Requirements and Business Process Modeling , 2016, ER Workshops.

[11]  Michael Burch,et al.  A Task-Based View on the Visual Analysis of Eye-Tracking Data , 2015, ETVIS.

[12]  Miguel Goulão,et al.  Usability Evaluation of Domain-Specific Languages , 2012, 2012 Eighth International Conference on the Quality of Information and Communications Technology.

[13]  Daniel Amyot,et al.  Evaluation of Development Tools for Domain-Specific Modeling Languages , 2006, SAM.

[14]  Natalia Juristo Juzgado,et al.  Are Students Representatives of Professionals in Software Engineering Experiments? , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[15]  Muhammad Zohaib Z. Iqbal,et al.  Empirical Evaluation of UML Modeling Tools-A Controlled Experiment , 2015, ECMFA.

[16]  Kurt Sandkuhl,et al.  Enterprise Modeling: Tackling Business Challenges with the 4EM Method , 2014 .

[17]  Alberto Rodrigues da Silva,et al.  Comparative analysis of workbenches to support DSMLs: Discussion with non-trivial Model-Driven Development needs , 2016, 2016 4th International Conference on Model-Driven Engineering and Software Development (MODELSWARD).

[18]  Harald Störrle.  Cost-effective evolution of research prototypes into end-user tools: The MACH case study , 2016, Sci. Comput. Program..

[19]  Christian Schalles.  Usability Evaluation of Modeling Languages , 2012 .

[20]  Tanja E. J. Vos,et al.  An empirical approach for evaluating the usability of model-driven tools , 2013, Sci. Comput. Program..

[21]  Daniel L. Moody,et al.  The “Physics” of Notations: Toward a Scientific Basis for Constructing Visual Notations in Software Engineering , 2009, IEEE Transactions on Software Engineering.

[22]  Oscar Pastor,et al.  Considerations about quality in model-driven engineering , 2016, Software Quality Journal.