Improving Diagram Assessment in Mooshak

Mooshak is a web system with support for assessment in computer science. It was originally developed for programming contest management but evolved to be used also as a pedagogical tool, capitalizing on its programming assessment features. The current version of Mooshak supports other forms of assessment used in computer science, such as diagram assessment. This form of assessment is supported by a set of new features, including a diagram editor, a graph comparator, and an environment for integration of pedagogical activities. The first attempt to integrate these features to support diagram assessment revealed a number of shortcomings, such as the lack of support for multiple diagrammatic languages, ineffective feedback, and usability issues. These shortcomings were addressed by the creation of a diagrammatic language definition language, the introduction of a new component for feedback summarization and a redesign of the diagram editor. This paper describes the design and implementation of these features, as well as their validation.

[1]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[2]  H. A. Razak,et al.  Discovery of Non-Interesting Attribute in Mining Outliers Pattern , 2007 .

[3]  V. Shute Focus on Formative Feedback , 2008 .

[4]  Chris J. Hinde,et al.  A diagram drawing tool for semi–automatic assessment of conceptual database diagrams , 2006 .

[5]  José Paulo Leal,et al.  A Structural Approach to Assess Graph-Based Exercises , 2015, SLATE.

[6]  R. Fabregat,et al.  A web-based e-learning tool for UML class diagrams , 2010, IEEE EDUCON 2010 Conference.

[7]  Sufian Idris,et al.  A Design of an Assessment System for UML Class Diagram , 2007 .

[8]  Sumit Gulwani,et al.  Automated Grading of DFA Constructions , 2013, IJCAI.

[9]  Jacques Wainer,et al.  A group critic system for object-oriented analysis and design , 2000, Proceedings ASE 2000. Fifteenth IEEE International Conference on Automated Software Engineering.

[10]  José Paulo Leal,et al.  Eshu: An Extensible Web Editor for Diagrammatic Languages , 2016, SLATE.

[11]  Zarina Shukur,et al.  The Design of ADAT: A Tool for Assessing Automata-Based Assignments , 2008 .

[12]  José Paulo Leal,et al.  Enki: A Pedagogical Services Aggregator for Learning Programming Languages , 2016, ITiCSE.

[13]  Pete Thomas Online Automatic Marking of Diagrams , 2013 .

[14]  José Paulo Leal,et al.  Mooshak: a Web‐based multi‐site programming contest system , 2003, Softw. Pract. Exp..

[15]  Vinay Vachharajani,et al.  A Proposed Architecture for Automated Assessment of Use Case Diagrams , 2014 .