Automatic Checklist Generation for the Assessment of UML Models

Assessing numerous models from students in written exams or homework is an exhausting task. We present an approach for a fair and transparent assessment of the completeness of models according to a natural language domain description. The assessment is based on checklists generated by the tool Sumo χ. Sumo χ directly works on an annotated version of the original exam text, so no ‘gold standard’ is needed.

[1]  D. C. Howell.  Fundamental Statistics for the Behavioral Sciences , 1985 .

[2]  Benno Geißelmann,et al.  Program Design by Informal English Descriptions , 2001 .

[3]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[4]  Parastoo Mohagheghi,et al.  Evaluating Quality in Model-Driven Engineering , 2007, International Workshop on Modeling in Software Engineering (MISE'07: ICSE Workshop 2007).

[5]  James F. Power,et al.  On the application of software metrics to UML models , 2006, MoDELS'06.

[6]  Walter F. Tichy,et al.  Thematic Role Based Generation of UML Models from Real World Requirements , 2007 .

[7]  Lionel C. Briand,et al.  Guiding the Application of Design Patterns Based on UML Models , 2006, 2006 22nd IEEE International Conference on Software Maintenance.

[8]  Michel R. V. Chaudron,et al.  Managing Model Quality in UML-Based Software Development , 2005, 13th IEEE International Workshop on Software Technology and Engineering Practice (STEP'05).

[9]  Michel R. V. Chaudron,et al.  In practice: UML software architecture and design description , 2006, IEEE Software.

[10]  Michel R. V. Chaudron,et al.  An empirical assessment of completeness in UML designs , 2004, ICSE 2004.

[11]  Kevin Lano,et al.  Slicing of UML models using model transformations , 2010, MODELS'10.

[12]  Daniel Grund,et al.  GrGen: A Fast SPO-Based Graph Rewriting Tool , 2006, ICGT.

[13]  Serge Demeyer,et al.  An experimental investigation of UML modeling conventions , 2006, MoDELS'06.

[14]  Michel R. V. Chaudron,et al.  Effects of defects in UML models: an experimental investigation , 2006, ICSE.

[15]  Cornelia Boldyreff,et al.  Developing Software Metrics Applicable to UML Models , 2002 .

[16]  Jochen Ludewig,et al.  Models in software engineering – an introduction , 2003, Software and Systems Modeling.

[17]  Sue Felshin,et al.  Answering English Questions using Foreign-Language, Semi-Structured Sources , 2007 .

[18]  Chris Rupp.  Requirements and Psychology , 2002, IEEE Softw..

[19]  Ana M. Moreno.  Object-Oriented Analysis from Textual Specifications , 2005 .