Learning Analytics and Digital Badges: Potential Impact on Student Retention in Higher Education

Learning analytics and digital badges are emerging research fields in educational science. They both show promise for enhancing student retention in higher education, where withdrawals prior to degree completion remain at about 30 % in Organisation for Economic Cooperation and Development member countries. This integrative review provides an overview of the theoretical literature as well as current practices and experience with learning analytics and digital badges in higher education with regard to their potential impact on student retention to enhance students’ first-year experience. Learning analytics involves measuring and analyzing dynamic student data in order to gain insight into students’ learning processes and optimize learning and teaching. One purpose of learning analytics is to construct predictive models to identify students who risk failing a course and thus are more likely to drop out of higher education. Personalized feedback provides students with information about academic support services, helping them to improve their skills and therefore be successful in higher education. Digital badges are symbols for certifying knowledge, skills, and competencies on web-based platforms. The intention is to encourage student persistence by motivating them, recognizing their generic skills, signaling their achievements, and capturing their learning paths. This article proposes a model that synthesizes learning analytics, digital badges, and generic skills such as academic competencies. The main idea is that generic skills can be represented as digital badges, which can be used for learning analytics algorithms to predict student success and to provide students with personalized feedback for improvement. Moreover, this model may serve as a platform for discussion and further research on learning analytics and digital badges to increase student retention in higher education.

[1]  Ian Dunwell,et al.  Foundations of dynamic learning analytics: Using university student data to increase retention , 2015, Br. J. Educ. Technol..

[2]  A. Bandura,et al.  Cultivating competence, self-efficacy, and intrinsic interest through proximal self-motivation. , 1981 .

[3]  Erik Duval,et al.  Learning Analytics Dashboard Applications , 2013 .

[4]  J. Hattie,et al.  The Power of Feedback , 2007 .

[5]  Geoffrey T. Crisp,et al.  First year student expectations: Results from a university-wide student survey , 2009, Journal of University Teaching and Learning Practice.

[6]  Adrianne Kinnear,et al.  Student and staff perceptions of the importance of generic skills in science , 2004 .

[7]  James E. Willis,et al.  Ethics, Big Data, and Analytics: A Model for Application , 2013 .

[8]  Kim Flintoff,et al.  Digital badges in education , 2013, Education and Information Technologies.

[9]  Vladan Devedzic,et al.  Open Badges: Novel Means to Motivate, Scaffold and Recognize Learning , 2015, Technol. Knowl. Learn..

[10]  Betsy O. Barefoot Exploring the evidence : reporting outcomes of first-year seminars , 1998 .

[11]  Joseph R. Fanfarelli,et al.  Building Better Digital Badges , 2016 .

[12]  David Waters Supporting First-Year Students in the Bachelor of Arts , 2003 .

[13]  Dirk Ifenthaler,et al.  Foundation of digital badges and micro-credentials : demonstrating and recognizing knowledge and competencies , 2016 .

[14]  Kimberly E. Arnold Signals: Applying Academic Analytics. , 2010 .

[15]  Tae-Yong Kim,et al.  A COMPUTER-ASSISTED LEARNING MODEL BASED ON THE DIGITAL GAME EXPONENTIAL REWARD SYSTEM , 2011 .

[16]  Meg Murray,et al.  Unraveling the Digital Literacy Paradox: How Higher Education Fails at the Fourth Literacy , 2014 .

[17]  Tanya Kantanis,et al.  The role of social transition in students' adjustment to the first-year of university , 2000 .

[18]  M. Evans,et al.  Planning for the transition to tertiary study: A literature review , 2000 .

[19]  J. Keller Development and use of the ARCS model of instructional design , 1987 .

[20]  Dirk Ifenthaler,et al.  Challenges for education in a connected world. Inaugural to the special issue Digital learning, data rich environments, and computer-based assessment , 2014 .

[21]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[22]  J. W. Atkinson Motivational determinants of risk-taking behavior. , 1957, Psychological review.

[23]  S. Mark Pancer,et al.  Great Expectations: The Relation Between Expectancies and Adjustment During the Transition to University1 , 2000 .

[24]  Sara de Freitas,et al.  Exploratory Analysis in Learning Analytics , 2016, Technol. Knowl. Learn..

[25]  E. Churchill,et al.  Badges in Social Media: A Social Psychological Perspective , 2011 .

[26]  J. Goldfinch,et al.  Skills, learning styles and success of first-year undergraduates , 2007 .

[27]  B. Weiner,et al.  Perceiving the Causes of Success and Failure , 1989 .

[28]  Cor Suhre,et al.  Readiness and expectations questionnaire: a cross-cultural measurement instrument for first-year university students , 2013 .

[29]  Tasman Bedford,et al.  Staff perceptions of factors related to non‐completion in higher education , 2004 .

[30]  P. Prinsloo,et al.  Learning Analytics , 2013 .

[31]  John P. Campbell,et al.  Academic Analytics: A New Tool for a New Era. , 2007 .

[32]  R. Nisbett,et al.  Undermining children's intrinsic interest with extrinsic reward: A test of the "overjustification" hypothesis. , 1973 .

[33]  Barbara S. Metzner,et al.  A Conceptual Model of Nontraditional Undergraduate Student Attrition , 1985 .

[34]  Allison Littlejohn,et al.  Are digital natives a myth or reality? University students' use of digital technologies , 2011, Comput. Educ..

[35]  Dirk Ifenthaler,et al.  Challenges for Education in a Connected World: Digital Learning, Data Rich Environments, and Computer-Based Assessment—Introduction to the Inaugural Special Issue of Technology, Knowledge and Learning , 2014, Technol. Knowl. Learn..

[36]  Ulrik Schroeder,et al.  A reference model for learning analytics , 2012 .

[37]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[38]  M. Prensky Do They Really Think Differently , 2001 .

[39]  George Siemens,et al.  Learning Analytics , 2013 .

[40]  S. A. Becker,et al.  NMC Horizon Report: 2016 Higher Education Edition , 2015 .

[41]  Dirk Ifenthaler,et al.  Development and Validation of a Learning Analytics Framework: Two Case Studies Using Support Vector Machines , 2014, Technol. Knowl. Learn..

[42]  Linda Corrin,et al.  Student retention and learning analytics: A snapshot of Australian practices and a framework for advancement , 2015 .

[43]  Eitel J. M. Lauría,et al.  Mining academic data to improve college student retention: an open source perspective , 2012, LAK.

[44]  Zdenek Zdráhal,et al.  Developing predictive models for early detection of at-risk students on distance learning modules , 2014, LAK Workshops.

[45]  Gareth Hughes,et al.  Which aspects of university life are most and least helpful in the transition to HE? A qualitative snapshot of student perceptions , 2015 .

[46]  Simon Buckingham Shum,et al.  Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics , 2012, International Conference on Learning Analytics and Knowledge.

[47]  A. P. Rovai In search of higher persistence rates in distance education online programs , 2003, Internet High. Educ..

[48]  D. Christopher Brooks,et al.  The Current Ecosystem of Learning Management Systems in Higher Education: Student, Faculty, and IT Perspectives. , 2014 .

[49]  Maren Scheffel,et al.  Quality Indicators for Learning Analytics , 2014, J. Educ. Technol. Soc..

[50]  S. Jaramillo,et al.  Adams Becker, S.; Cummins, M.; Davis, A.; Freeman, A.; Hall Giesinger, C.; Ananthanarayanan, V. NMC Horizon Report: 2017 Higher Education Edition. Austin, Texas: The New Media Consortium, 2017 , 2017 .

[51]  Donald MacLean,et al.  Keep Taking the Tablets? Assessing the Use of Tablet Devices in Learning and Teaching Activities in the Further Education Sector , 2014 .

[52]  George Siemens,et al.  The Open Course: Through the Open Door--Open Courses as Research, Learning, and Engagement , 2010 .

[53]  Rolf Schulmeister Students, Internet, eLearning and Web 2.0 , 2010 .

[54]  Mahsood Shah,et al.  Improving Student Retention: A University of Western Sydney Case Study. , 2008 .

[55]  Elizabeth C. Metzger,et al.  Applied Gamification: Creating Reward Systems for Organizational Professional Development , 2016 .

[56]  George Siemens,et al.  Learning analytics: envisioning a research discipline and a domain of practice , 2012, LAK.

[57]  Louis S. Nadelson,et al.  Why Did They Come Here?: The Influences and Expectations of First-Year Students’ College Experience , 2013 .

[58]  Nicole L. Cundiff,et al.  Assessing the Effectiveness of a College Freshman Seminar Using Propensity Score Adjustments , 2011 .

[59]  Heinz Heckhausen,et al.  Achievement motivation in perspective , 1985 .

[60]  Sharon Slade,et al.  Learning analytics and higher education: ethical perspectives , 2012, LAK '12.

[61]  J. Elizabeth,et al.  Student Success in College: Creating Conditions That Matter , 2012 .

[62]  Linda Corrin,et al.  Enhancing learning analytics by understanding the needs of teachers , 2013 .

[63]  Julie Cotter,et al.  Beyond the first‐year experience: the impact on attrition of student experiences throughout undergraduate degree studies in six diverse universities , 2011 .

[64]  Russell S. A. Brinkworth,et al.  First year expectations and experiences: student and teacher perspectives , 2009 .

[65]  Ian Glover,et al.  Investigating Perceptions and Potential of Open Badges in Formal Higher Education , 2013 .

[66]  Margaret Wu,et al.  FROM GIRL SCOUT TO GROWN UP: EMERGING APPLICATIONS OF DIGITAL BAGES IN HIGHER EDUCATION , 2015 .

[67]  Mart Laanpere,et al.  Exploring the Potential of Open Badges in Blog-Based University Courses , 2014, ICWL Workshops.

[68]  M. Prensky Digital Natives, Digital Immigrants , 2001 .

[69]  Ross M. Higashi,et al.  Are badges useful in education?: it depends upon the type of badge and expertise of learner , 2013 .

[70]  Zane L. Berge,et al.  Digital Badges, Learning at Scale, and Big Data , 2016 .

[71]  Alexander Halavais A GENEALOGY OF BADGES , 2012 .

[72]  Daniel T. Hickey,et al.  Design Principles for Motivating Learning with Digital Badges: Consideration of Contextual Factors of Recognition and Assessment , 2014, ICLS.

[73]  Ron James Fisher,et al.  Staying the distance: students’ perceptions of enablers of transition to higher education , 2014 .

[74]  Dragan Gasevic,et al.  Ethics and Privacy as Enablers of Learning Analytics , 2016 .

[75]  Martin Ebner,et al.  Learning Analytics: From Theory to Practice - Data Support for Learning and Teaching , 2014, CAA.

[76]  J. Herman,et al.  Defining Twenty-First Century Skills , 2012 .

[77]  Brian S. Butler,et al.  Open badges for education: what are the implications at the intersection of open systems and badging? , 2014 .

[78]  Joshua S. Smith,et al.  Do First-Year College Students' Expectations Align with their First-Year Experiences? , 2005 .

[79]  U. Wingate Doing away with ‘study skills’ , 2006 .

[80]  Chi Baik,et al.  The First Year Experience in Australian Universities: Findings from two decades, 1994-2014 , 2015 .

[81]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[82]  B. Weiner An attributional theory of achievement motivation and emotion. , 1985, Psychological review.

[83]  Kerri-Lee Krause,et al.  Serious thoughts about dropping out in first year: Trends, patterns and implications for higher education , 2005 .

[84]  Hélène Fournier,et al.  The value of learning analytics to networked learning on a personal learning environment , 2011, LAK.

[85]  Vincent Tinto,et al.  Completing College: Rethinking Institutional Action , 2012 .

[86]  E. Deci Effects of Externally Mediated Rewards on Intrinsic Motivation. , 1971 .

[87]  Abigail Selzer King,et al.  Using Signals for appropriate feedback: Perceptions and practices , 2011, Comput. Educ..

[88]  Kwok-Wing Lai,et al.  Technology use and learning characteristics of students in higher education: Do generational differences exist? , 2015, Br. J. Educ. Technol..

[89]  Ian Glover Student Perceptions of Digital Badges as Recognition of Achievement and Engagement in Co-curricular Activities , 2016 .

[90]  M. Prensky Digital Natives, Digital Immigrants Part 1 , 2001 .

[91]  Robert D. Reason,et al.  First Things First: Developing Academic Competence in the First Year of College* , 2006 .

[92]  F. Försterling,et al.  Attribution: An Introduction to Theories, Research and Applications , 2001 .

[93]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[94]  Eitel J. M. Lauría,et al.  Early Alert of Academically At-Risk Students: An Open Source Analytics Initiative , 2014, J. Learn. Anal..

[95]  Hendrik Drachsler,et al.  Privacy and analytics: it's a DELICATE issue a checklist for trusted learning analytics , 2016, LAK.

[96]  James E. Willis,et al.  Digital Badges and Ethics: The Uses of Individual Learning Data in Social Contexts , 2015, OBIE@LAK.

[97]  Ulrich Heublein,et al.  Student Drop-Out from German Higher Education Institutions. , 2014 .

[98]  Vincent Tinto Dropout from Higher Education: A Theoretical Synthesis of Recent Research , 1975 .

[99]  Mantz Yorke,et al.  The first-year experience in higher education in the UK:final report , 2008 .

[100]  A. Bandura,et al.  Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. , 1983 .

[101]  Jennifer R. Keup,et al.  The Impact of Curricular Interventions on Intended Second Year Re-Enrollment , 2005 .

[102]  Mike Sharkey,et al.  Course correction: using analytics to predict course success , 2012, LAK '12.

[103]  John Clanchy,et al.  Generic Skills in the Context of Higher Education. , 1995 .

[104]  Zdenek Zdráhal,et al.  Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment , 2013, LAK '13.

[105]  Neville Bennett,et al.  Patterns of core and generic skill provision in higher education , 1999 .

[106]  Rebecca Ferguson,et al.  Guest Editorial: Ethics and Privacy in Learning Analytics , 2016, J. Learn. Anal..

[107]  George Siemens,et al.  Ethical and privacy principles for learning analytics , 2014, Br. J. Educ. Technol..

[108]  Maren Scheffel,et al.  Developing an evaluation framework of quality indicators for learning analytics , 2015, LAK.

[109]  Arnon Hershkovitz,et al.  About "Learning" and "Analytics" , 2016 .

[110]  L. Thomas Student retention in higher education: the role of institutional habitus , 2002, Bourdieu and Education.

[111]  Paul Prinsloo,et al.  An evaluation of policy frameworks for addressing ethical considerations in learning analytics , 2013, LAK '13.

[112]  Matthew D. Pistilli,et al.  In practice: Purdue Signals: Mining real‐time academic data to enhance student success , 2010 .

[113]  Larry Johnson,et al.  The NMC Horizon Report: 2012 Higher Education Edition. , 2012 .

[114]  Anastasios A. Economides,et al.  Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence , 2014, J. Educ. Technol. Soc..

[115]  Neil Selwyn,et al.  The digital native - myth and reality , 2009, Aslib Proc..

[116]  S. Schwartz,et al.  Leaving College: Rethinking the Causes and Cures of Student Attrition , 1987 .

[117]  Jinan Fiaidhi,et al.  The Next Step for Learning Analytics , 2014, IT Prof..

[118]  E. Deci,et al.  Motivation and Education: The Self-Determination Perspective , 2008 .

[119]  Richard E. West,et al.  Giving Credit Where Credit Is Due: Designing Open Badges for a Technology Integration Course , 2013 .

[120]  Shady Shehata,et al.  Measuring student success using predictive engine , 2015, LAK.

[121]  Patrick Griffin,et al.  Assessment and Teaching of 21st Century Skills , 2011 .