Significantly Increasing the Usability of Model Analysis Tools through Visual Feedback

A plethora of theoretical results are available which make possible the use of dynamic analysis and model-checking for software and system models expressed in high-level modeling languages like UML, SDL or AADL. Their usage is hindered by the complexity of information processing demanded from the modeler in order to apply them and to effectively exploit their results. Our thesis is that by improving the visual presentation of the analysis results, their exploitation can be highly improved. To support this thesis, we define a trace analysis approach based on the extraction of high-level semantics events from the low-level output of a simulation or model-checking tool. This extraction offers the basis for new types of scenario visualizations, improving scenario understanding and exploration. This approach was implemented in our UML/SysML analyzer and was validated in a controlled experiment that shows a significant increase in the usability of our tool, both in terms of task performance speed and in terms of user satisfaction.

[1]  Benoît Combemale,et al.  A Generic Tool for Tracing Executions Back to a DSML's Operational Semantics , 2011, ECMFA.

[2]  Steffen Zschaler,et al.  Modular DSLs for Flexible Analysis: An e-Motions Reimplementation of Palladio , 2014, ECMFA.

[3]  Iulian Ober,et al.  OMEGA2: A New Version of the Profile and the Tools , 2010, 2010 15th IEEE International Conference on Engineering of Complex Computer Systems.

[4]  Iulian Ober,et al.  Seeing errors: model driven simulation trace visualization , 2012, MODELS'12.

[5]  Joseph Sifakis,et al.  Tools and Applications II: The IF Toolset , 2004 .

[6]  Johan Lilius,et al.  vUML: a tool for verifying UML models , 1999, 14th IEEE International Conference on Automated Software Engineering.

[7]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[8]  Guy H. Walker,et al.  Human Factors Methods: A Practical Guide for Engineering and Design , 2012 .

[9]  Jean-Michel Bruel,et al.  Satellite Events at the MoDELS 2005 Conference , 2006 .

[10]  Natalia Juristo Juzgado,et al.  Basics of Software Engineering Experimentation , 2010, Springer US.

[11]  Sébastien Gérard,et al.  Optimum: a MARTE-based methodology for schedulability analysis at early design stages , 2011, SOEN.

[12]  Daniel L. Moody,et al.  The “Physics” of Notations: Toward a Scientific Basis for Constructing Visual Notations in Software Engineering , 2009, IEEE Transactions on Software Engineering.

[13]  Iulian Ober,et al.  Formal Model Driven Engineering for Space Onboard Software , 2011 .

[14]  Masahito Kurihara,et al.  User-friendly GUI in software model checking , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[15]  Iulian Ober,et al.  Timing analysis and validation with UML: the case of the embedded MARS bus manager , 2008, Innovations in Systems and Software Engineering.

[16]  Jeffrey G. Gray,et al.  DSMDiff: a differentiation tool for domain-specific models , 2007 .

[17]  Joseph Sifakis,et al.  The IF Toolset , 2004, SFM.

[18]  Gerard J. Holzmann,et al.  Design and validation of computer protocols , 1991 .

[19]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[20]  Jean-Philippe Babau,et al.  RT-simex: retro-analysis of execution traces , 2010, FSE '10.

[21]  Kevin Lano,et al.  Slicing of UML models using model transformations , 2010, MODELS'10.

[22]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[23]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[24]  Sébastien Gérard,et al.  Annotating UML Models with Non-functional Properties for Quantitative Analysis , 2005, MoDELS Satellite Events.

[25]  Mark Rouncefield,et al.  Empirical assessment of MDE in industry , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[26]  Opher Etzion,et al.  Event Processing in Action , 2010 .

[27]  Iulian Ober,et al.  Modeling and Validation of a Software Architecture for the Ariane-5 Launcher , 2006, FMOODS.

[28]  J. Sweller Evolution of human cognitive architecture , 2003 .