Assessing the effectiveness of feedback enabled simulation in teaching conceptual modeling

It is commonly accepted that simulation contributes to a better learning quality while also promoting successful transfer of the skills to real-world environments. However, the practical use of simulation is hampered by the difficulty of interpreting simulation results. This paper demonstrates the learning benefits in conceptual modeling of business requirements when using feedback-enabled simulation. The effects of feedback-enabled simulation on learning outcomes of novice learners were observed by means of experimental empirical studies. Three studies were conducted in the context of two master-level courses from two different study programs spanning two academic years. The findings show a significant improvement in students' conceptual model understanding and validation capabilities when using feedback-enabled simulation.

[1]  Antoni Olivé,et al.  Validating Conceptual Specifications Through Model Execution , 1996, Inf. Syst..

[2]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[3]  A. Kluge.  Experiential Learning Methods, Simulation Complexity and Their Effects on Different Target Groups , 2007 .

[4]  Chin-Lung Hsu,et al.  Consumer behavior in online game communities: A motivational factor perspective , 2007, Comput. Hum. Behav..

[5]  Mario Piattini,et al.  A conceptual modeling quality framework , 2011, Software Quality Journal.

[6]  John P. Buerck,et al.  Facilitating Self-Regulated Learning With Technology , 2011 .

[7]  V. Shute.  Focus on Formative Feedback , 2007 .

[8]  Keng Siau,et al.  Can UML Be Simplified? Practitioner Use of UML in Separate Domains , 2007, EMMSAD.

[9]  Slavomir Stankov,et al.  Controlled experiment replication in evaluation of e-learning system's educational influence , 2009, Comput. Educ..

[10]  Jan Recker,et al.  Process Model Comprehension: The Effects of Cognitive Abilities, Learning Style, and Strategy , 2014, Commun. Assoc. Inf. Syst..

[11]  Ravi Paul,et al.  Analyzing the structure of expert knowledge , 2006, Inf. Manag..

[12]  Paul Jen-Hwa Hu,et al.  Examining technology acceptance by school teachers: a longitudinal study , 2003, Inf. Manag..

[13]  Albert H. Segars,et al.  Re-examining perceived ease of use and usefulness , 1993 .

[14]  Nicholas P. Vitalari,et al.  Differences Between Novice and Expert Systems Analysts: What Do We Know and What Do We Do? , 1998, J. Manag. Inf. Syst..

[15]  Maria Manuela Cunha,et al.  Simulation in Information Systems: Potential of the Vulnerability Theory , 2010, CENTERIS.

[16]  Maria C. Yang,et al.  A study of prototypes, design activity, and design outcome , 2005 .

[17]  Pericles Loucopoulos,et al.  Visualisation for Validation , 1993, CAiSE.

[18]  Monique Snoeck,et al.  Implementing Consistency Management Techniques for Conceptual Modeling , 2005 .

[19]  Monique Snoeck,et al.  Technology-Enhanced Support for Learning Conceptual Modeling , 2012, BMMDS/EMMSAD.

[20]  Monique Snoeck,et al.  Computer Aided Modelling Exercises , 2007, Informatics Educ..

[21]  A. Alan B. Pritsker,et al.  Introduction to simulation and SLAM II , 1979 .

[22]  Marian Petre,et al.  Why looking isn't always seeing: readership skills and graphical programming , 1995, CACM.

[23]  S. Narciss.  Feedback Strategies for Interactive Learning Tasks , 2007 .

[24]  Ramesh Sharda,et al.  Innovative Teaching Using Simulation and Virtual Environments , 2012 .

[25]  Ketil Stølen,et al.  What is model driven architecture , 2003 .

[26]  Marcin Szlenk.  Formal Semantics and Reasoning about UML Class Diagram , 2006, 2006 International Conference on Dependability of Computer Systems.

[27]  Keng Siau,et al.  Identifying Difficulties in Learning Uml , 2006, Inf. Syst. Manag..

[28]  Daniel L. Moody,et al.  The “Physics” of Notations: Toward a Scientific Basis for Constructing Visual Notations in Software Engineering , 2009, IEEE Transactions on Software Engineering.

[29]  Tammy Schellens,et al.  Students' perceptions about the use of video games in the classroom , 2010, Comput. Educ..

[30]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[31]  Mark L. Mitchell,et al.  Research Design Explained , 1987 .

[32]  Sean Brophy,et al.  Teaching an aerospace engineering design course via virtual worlds: A comparative assessment of learning outcomes , 2013, Comput. Educ..

[33]  Patrick Wessa,et al.  A constructivist approach in a blended e-learning environment for statistics , 2015, Interact. Learn. Environ..

[34]  J. Krosnick,et al.  Complete anonymity compromises the accuracy of self-reports , 2012 .

[35]  E. Tansley,et al.  Using ontology to validate conceptual models , 2003, CACM.

[36]  William M. K. Trochim,et al.  Research methods knowledge base , 2001 .

[37]  B. Zimmerman.  Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects , 2008, American Educational Research Journal.

[38]  Christina Keller,et al.  User Acceptance of Virtual Learning Environments: A Case Study from Three Northern European Universities , 2009, Commun. Assoc. Inf. Syst..

[39]  P VitalariNicholas,et al.  Differences between novice and expert systems analysts , 1998 .

[40]  Jerry Banks.  Introduction to simulation , 1999, WSC '99.

[41]  Timothy Paul Cronan,et al.  Toward an empirical understanding of computer simulation implementation success , 2000, Inf. Manag..

[42]  Monique Snoeck,et al.  Consistency by Construction: The Case of MERODE , 2003, ER.

[43]  Wang Wang,et al.  Empirical investigations of conceptual modeling and the modeling process , 2007, 2007 Winter Simulation Conference.

[44]  Monique Snoeck,et al.  A PIM-to-Code Requirements Engineering Framework , 2013, MODELSWARD.

[45]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[46]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[47]  Chris Marshall,et al.  Enterprise modeling with UML: designing successful software through business analysis , 2000 .

[48]  Nicola Careddu,et al.  Mine simulation for educational purposes: A case study , 2015, Comput. Appl. Eng. Educ..

[49]  Diego Calvanese,et al.  Reasoning on UML class diagrams , 2005, Artif. Intell..

[50]  Timothy A. Hess.  Investigation of Prototype Roles in Conceptual Design using Case Study and Protocol Study Methods , 2012 .

[51]  Jan Mendling,et al.  What Makes Process Models Understandable? , 2007, BPM.

[52]  Said Hadjerrouit.  Object-Oriented Software Development Education: a Constructivist Framework , 2005, Informatics Educ..

[53]  John Krogstie,et al.  Validating Conceptual Models by Transformational Prototyping , 1993, CAiSE.

[54]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[55]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[56]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[57]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[58]  Yair Wand,et al.  Theoretical foundations for conceptual modelling in information systems development , 1995, Decis. Support Syst..

[59]  Ilia Bider,et al.  Enterprise, Business-Process and Information Systems Modeling , 2014, Lecture Notes in Business Information Processing.

[60]  Monique Snoeck,et al.  Feedback-Enabled MDA-Prototyping Effects on Modeling Knowledge , 2013, BMMDS/EMMSAD.

[61]  Ashim K. Datta,et al.  Simulation as an integrator in an undergraduate biological engineering curriculum , 2013, Comput. Appl. Eng. Educ..

[62]  Jan Recker,et al.  How Novices Model Business Processes , 2010, BPM.

[63]  Arne Sølvberg,et al.  Understanding quality in conceptual modeling , 1994, IEEE Software.

[64]  Bernhard Thalheim,et al.  Handbook of Conceptual Modeling - Theory, Practice, and Research Challenges , 2011 .

[65]  Ricki G. Ingalls,et al.  Introduction to simulation , 2013, 2013 Winter Simulations Conference (WSC).

[66]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[67]  Jan T. van der Veen,et al.  The learning effects of computer simulations in science education , 2012, Comput. Educ..