Teaching smarter: how mining ICT data can inform and improve learning and teaching practice

The trend to greater adoption of online learning in higher education institutions means an increased opportunity for instructors and administrators to monitor student activity and interaction with the course content and peers. This paper demonstrates how the analysis of data captured from various IT systems could be used to inform decision making process for university management and administration. It does so by providing details of a large research project designed to identify the range of applications for LMS derived data for informing strategic decision makers and teaching staff. The visualisation of online student engagement/effort is shown to afford instructors with early opportunities for providing additional student learning assistance and intervention ‐ when and where it is required. The capacity to establish early indicators of ‘at-risk’ students provides timely opportunities for instructors to re-direct or add resources to facilitate progression towards optimal patterns of learning behaviour. The project findings provide new insights into student learning that complement the existing array of evaluative methodologies, including formal evaluations of teaching. Thus the project provides a platform for further investigation into new suites of diagnostic tools that can, in turn, provide new opportunities to inform continuous, sustained improvement of pedagogical practice.

[1]  Shane Dawson,et al.  Online forum discussion interactions as an indicator of student community , 2006 .

[2]  Ron Oliver,et al.  Online learning communities: Investigating a design framework , 2003 .

[3]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[4]  A. P. Rovai Building Sense of Community at a Distance , 2002, Distances et médiations des savoirs.

[5]  Marcel S. Kerr,et al.  Student characteristics for online learning success , 2006, Internet High. Educ..

[6]  William Doherty,et al.  An analysis of multiple factors affecting retention in Web-based community college courses , 2006, Internet High. Educ..

[7]  J. F. Ryan,et al.  Institutional Expenditures and Student Engagement: a Role for Financial Resources in Enhancing Student Learning and Development? , 2005 .

[8]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[9]  H. Coates The value of student engagement for higher education quality assurance , 2005 .

[10]  Shane Dawson,et al.  A study of the relationship between student communication interaction and sense of community , 2006, Internet High. Educ..

[11]  E. Rogers Diffusion of Innovations , 1962 .

[12]  A. P. Rovai In search of higher persistence rates in distance education online programs , 2003, Internet High. Educ..

[13]  John P. Campbell,et al.  Academic Analytics: A New Tool for a New Era. , 2007 .

[14]  John M. Silvester,et al.  The Social Life of Information: Brown, J.S., & Duguid, P. (2000). Cambridge, MA: Harvard Business School Publishing. ISBN 0-87584-762-5. 320 pages , 2000, Internet High. Educ..

[15]  Zane L. Berge,et al.  Review of research in distance education, 1990 to 1999 , 2001 .

[16]  Jodi H. Levine,et al.  Creating Learning Communities: A Practical Guide to Winning Support, Organizing for Change, and Implementing Programs , 1999 .

[17]  Vania Dimitrova,et al.  CourseVis: A graphical student monitoring tool for supporting instructors in web-based distance courses , 2007, Int. J. Hum. Comput. Stud..

[18]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[19]  Lynda R. Ross,et al.  Relationships between Gender and Success in Distance Education Courses: A Preliminary Investigation. , 1990 .

[20]  Cathy Owens Swift,et al.  Retaining the Online Learner: Profile of Students in an Online MBA Program and Implications for Teaching Them , 2004 .

[21]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[22]  Peggy A. Ertmer,et al.  The expert learner: Strategic, self-regulated, and reflective , 1996 .

[23]  Daniel V. Eastmond E-Moderating: The Key to Teaching and Learning Online , 2003 .

[24]  L. Morris,et al.  Tracking student behavior, persistence, and achievement in online courses , 2005, Internet High. Educ..

[25]  John Seely Brown,et al.  Book Reviews : The Social Life of Information By John Seely Brown and Paul Duguid. Boston: Harvard Business School Press, 2000. 320 pages , 2000 .

[26]  Shane Dawson,et al.  A Study of the Relationship between Student Social Networks and Sense of Community , 2008, J. Educ. Technol. Soc..