Integrating design science research and design based research frameworks for developing education support systems

This paper proposes an integrated research framework that takes advantage of the similarities of design science research (DSR) and Design-based research (DBR) for developing a new decision support system (DSS) artefact. Firstly, the paper discusses the progression of DSR in the Information Systems and evolution of DBR in educational technology notifying the similarities and limitations. Next, we apply our proposed framework combining DSR and DBR to develop and effectively evaluate the artefact of the Educational DSS that can be used to identify students at risk and improve student retention and completion rate. Further, our paper creates a basis of methodological guide to construct and evaluate a machine learning (ML) based DSS artefact by conformity to the features and tenets of commonalities between DSR and DBR and correlating them to Peffer’s design science research approach. In line with the characteristic of DSR and DBR, the development framework that we proposed will be used as a new source of knowledge to design any IT artefact in the education domain.

[1]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[2]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[3]  Jay F. Nunamaker,et al.  Systems Development in Information Systems Research , 1990, J. Manag. Inf. Syst..

[4]  Omar El Sawy,et al.  Building an Information System Design Theory for Vigilant EIS , 1992, Inf. Syst. Res..

[5]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[6]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[7]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[8]  Arthur L. Samuel,et al.  Some studies in machine learning using the game of checkers , 2000, IBM J. Res. Dev..

[9]  Sandeep Purao,et al.  Design Research in the Technology of Information Systems: Truth or Dare , 2002 .

[10]  R. Sternberg.  What Is an “Expert Student?” , 2003 .

[11]  Design-Based Research: An Emerging Paradigm for Educational Inquiry , 2003 .

[12]  A. Georges L. Romme,et al.  Organizing Education by Drawing on Organization Studies , 2003 .

[13]  Allan Collins,et al.  Design Research: Theoretical and Methodological Issues , 2004 .

[14]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[15]  K. Squire,et al.  Design-Based Research: Putting a Stake in the Ground , 2004 .

[16]  Feng Wang,et al.  Design-based research and technology-enhanced learning environments , 2005 .

[17]  Simone C. O. Conceição,et al.  Using Developmental Research to Design, Develop, and Evaluate an Urban Education Portal , 2004 .

[18]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[19]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[20]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[21]  Vijay K. Vaishnavi,et al.  Design Science Research Methods and Patterns: Innovating Information and Communication Technology , 2007 .

[22]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[23]  Vijay K. Vaishnavi,et al.  Theory Development in Design Science Research: Anatomy of a Research Project , 2008 .

[24]  Shah Jahan Miah,et al.  A generic design environment for the rural industry knowledge acquisition , 2008, Knowl. Based Syst..

[25]  Georges Romme,et al.  Reinventing the future: adding design science to the repertoire of organization and management studies , 2009 .

[26]  Alan R. Hevner,et al.  Design Research in Information Systems , 2010 .

[27]  Susan McKenney,et al.  Conducting Educational Design Research , 2012 .

[28]  S. Chatterjee,et al.  Design Science Research in Information Systems , 2010 .

[29]  Thomas C. Reeves,et al.  The implications of the differences between design research and instructional systems design for educational technology researchers and practitioners , 2010 .

[30]  Shah Jahan Miah,et al.  A Cloud-Based DSS Model for Driver Safety and Monitoring on Australian Roads , 2011 .

[31]  Yolande E. Chan,et al.  A Multilevel Model for Measuring Fit Between a Firm's Competitive Strategies and Information Systems Capabilities , 2011, MIS Q..

[32]  Susan McKenney,et al.  Educational design research , 2014 .

[33]  T. Anderson,et al.  Design-Based Research , 2012 .

[34]  Alan R. Hevner,et al.  POSITIONING AND PRESENTING DESIGN SCIENCE RESEARCH FOR MAXIMUM IMPACT 1 , 2013 .

[35]  Matthew W. Easterday,et al.  Design-Based Research Process: Problems, Phases, and Applications , 2014, ICLS.

[36]  Alejandro Peña-Ayala.  Review: Educational data mining: A survey and a data mining-based analysis of recent works , 2014 .

[37]  Shah Jahan Miah,et al.  A collective artefact design of decision support systems: design science research perspective , 2014, Inf. Technol. People.

[38]  Shah Jahan Miah,et al.  A design science research methodology for developing a computer-aided assessment approach using method marking concept , 2015, Education and Information Technologies.

[39]  Davide Anguita,et al.  A Learning Analytics Approach to Correlate the Academic Achievements of Students with Interaction Data from an Educational Simulator , 2015, EC-TEL.

[40]  Peter Reimann,et al.  Connecting learning analytics with learning research: the role of design-based research , 2016 .

[41]  O. Aljohani.  A Comprehensive Review of the Major Studies and Theoretical Models of Student Retention in Higher Education. , 2016 .

[42]  Colin Beer,et al.  The problem of student attrition in higher education: An alternative perspective , 2017 .

[43]  Ramesh Sharda,et al.  Preparing a Data Scientist: A Pedagogic Experience in Designing a Big Data Analytics Course , 2017 .

[44]  Zdenek Zdráhal,et al.  Implementing predictive learning analytics on a large scale: the teacher's perspective , 2017, LAK.

[45]  Yang Liu,et al.  Using Design-Based Research to Develop Meaningful Online Discussions in Undergraduate Field Experience Courses , 2017 .

[46]  Shah Jahan Miah,et al.  Design of a mobile-based learning management system for incorporating employment demands: Case context of an Australian University , 2018, Education and Information Technologies.

[47]  Jonte Bernhard,et al.  Design science research – a powerful tool for improving methods in engineering education research , 2018, European Journal of Engineering Education.

[48]  Veda C. Storey,et al.  Aesthetics in design science research , 2018, Eur. J. Inf. Syst..

[49]  Laurent Renard,et al.  Design Science Research: Issues, Debates and Contributions , 2018 .

[50]  Rosemary Luckin,et al.  Designing educational technologies in the age of AI: A learning sciences-driven approach , 2019, Br. J. Educ. Technol..

[51]  Harry B. Santoso,et al.  Online Learners' Behaviors Detection Using Exploratory Data Analysis and Machine Learning Approach , 2019, 2019 Fourth International Conference on Informatics and Computing (ICIC).

[52]  Shah Jahan Miah,et al.  A design-based research approach for developing data-focussed business curricula , 2019, Education and Information Technologies.

[53]  A. Parmaxi,et al.  Lessons learned from a design-based research implementation: a researcher’s methodological account , 2020, International Journal of Research & Method in Education.

[54]  Alexander Maedche,et al.  The DSR grid: six core dimensions for effectively planning and communicating design science research projects , 2019, Electronic Markets.

[55]  Adele Botha,et al.  Building a Digital Health Innovation Ecosystem Framework through Design Science Research , 2019, 2019 Conference on Next Generation Computing Applications (NextComp).

[56]  Judy McKay,et al.  A Metadesign Theory for Tailorable Decision Support , 2019, J. Assoc. Inf. Syst..

[57]  Alan R. Hevner,et al.  Special Issue Editorial - Accumulation and Evolution of Design Knowledge in Design Science Research: A Journey Through Time and Space , 2020, J. Assoc. Inf. Syst..

[58]  Paul Benjamin Lowry,et al.  Using Design-Science Based Gamification to Improve Organizational Security Training and Compliance , 2020, J. Manag. Inf. Syst..

[59]  Alan R. Hevner,et al.  Accumulation and Evolution of Design Knowledge in Design Science Research: A Journey Through Time and Space , 2020 .

[60]  Yves Pigneur,et al.  A Design Theory for Visual Inquiry Tools , 2020, J. Assoc. Inf. Syst..