Using institutional data to predict student course selections in higher education

Abstract The ability to predict what university course a student may select has important quality assurance and economic imperatives. The capacity to determine future course load and student interests provides for increased accuracy in the allocation of resources including curriculum and learning support and career counselling services. Prior research in data mining has identified several models that can be applied to predict course selection based on the data residing in institutional information systems. However, these models only aim to predict the total number of students that may potentially enrol in a course. This prior work has not examined the prediction of the course enrolments with respect to the specific academic term and year in which the students will take those courses in the future. Moreover, these prior models operate under the assumption that all data stored within institutional information systems can be directly associated with an individual student's identity. This association with student identity is not always feasible due to government regulations (e.g., student evaluations of teaching and courses). In this paper, we propose an approach for extracting student preferences from sources available in institutional student information systems. The extracted preferences are analysed using the Analytical Hierarchy Process (AHP), to predict student course selection. The AHP-based approach was validated on a dataset collected in an undergraduate degree program at a Canadian research-intensive university (N = 1061). The results demonstrate that the accuracy of the student course predictions was high and equivalent to that of previous data mining approaches using fully identifiable data. The findings suggest that a students' grade point average relative to the grades of the courses they are considering for enrolment was the most important factor in determining future course selections. This finding is consistent with theories of modern counseling psychology that acknowledges self-efficacy as a critical factor in career planning.

[1]  John M. Darley,et al.  Developmental aspects in students' course selection , 1999 .

[2]  Robert W. Lent,et al.  Relation of Contextual Supports and Barriers to Choice Behavior in Engineering Majors: Test of Alternative Social Cognitive Models. , 2003 .

[3]  Dragan Gasevic,et al.  A stratified framework for handling conditional preferences: An extension of the analytic hierarchy process , 2013, Expert Syst. Appl..

[4]  KimMarie McGoldrick,et al.  A Conjoint Analysis of Student Registration Decision Making: Implications for Enrollment. , 1999 .

[5]  Elisha Y. Babad,et al.  Experimental analysis of students' course selection. , 2003, The British journal of educational psychology.

[6]  Leah P. Macfadyen,et al.  Using Social Network Metrics to Assess the Effectiveness of Broad Based Admission Practices. , 2011 .

[7]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[8]  Manoj Bala,et al.  STUDY OF APPLICATIONS OF DATA MINING TECHNIQUES IN EDUCATION , 2012 .

[9]  Saul I. Gass,et al.  The Analytic Hierarchy Process - An Exposition , 2001, Oper. Res..

[10]  Eugene Borgida,et al.  Scientific deduction—evidence is not necessarily informative: A reply to Wells and Harvey. , 1978 .

[11]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[12]  John P. Campbell,et al.  Academic Analytics: A New Tool for a New Era. , 2007 .

[13]  John A. Centra,et al.  Will Teachers Receive Higher Student Evaluations by Giving Higher Grades and Less Course Work? , 2003 .

[14]  Manos Tsakiris,et al.  The Experience of Agency , 2009 .

[15]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[16]  Kristy J. Lauver,et al.  Do psychosocial and study skill factors predict college outcomes? A meta-analysis. , 2004, Psychological bulletin.

[17]  James Marshall,et al.  How would they choose? Online student preferences for advance course information , 2012 .

[18]  Mykola Pechenizkiy,et al.  Handbook of Educational Data Mining , 2010 .

[19]  H. Lehmann,et al.  Clinical Decision Support Systems (cdsss) Have Been Hailed for Their Potential to Reduce Medical Errors Clinical Decision Support Systems for the Practice of Evidence-based Medicine , 2022 .

[20]  Luis Martínez,et al.  Orieb, A Crs For Academic Orientation Using Qualitative Assessments , 2008, e-Learning.

[21]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[22]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[23]  Nic Wilson,et al.  Computational techniques for a simple theory of conditional preferences , 2011, Artif. Intell..

[24]  Alvaro Ortigosa,et al.  Recommendation in Higher Education Using Data Mining Techniques , 2009, EDM.

[25]  Vincent Tinto,et al.  Research and Practice of Student Retention: What Next? , 2006 .

[26]  Haruna Chiroma,et al.  Data Mining for Education Decision Support: A Review , 2014, Int. J. Emerg. Technol. Learn..

[27]  Geraldine Clarebout,et al.  Tool-use in a blended undergraduate course: In Search of user profiles , 2011, Comput. Educ..

[28]  Elisha Y. Babad,et al.  Students' Course Selection: Differential Considerations for First and Last Course , 2001 .

[29]  Norman Blaikie,et al.  Analyzing Quantitative Data , 2012 .

[30]  Alvaro Ortigosa,et al.  A data mining approach to guide students through the enrollment process based on academic performance , 2011, User Modeling and User-Adapted Interaction.

[31]  J. Arbaugh,et al.  Technological and Structural Characteristics, Student Learning and Satisfaction with Web-Based Courses , 2002 .

[32]  Ming-Kuen Chen,et al.  The critical factors of success for information service industry in developing international market: Using analytic hierarchy process (AHP) approach , 2010, Expert Syst. Appl..

[33]  Shane Dawson,et al.  Online forum discussion interactions as an indicator of student community , 2006 .

[34]  P. Spooren,et al.  On the Validity of Student Evaluation of Teaching , 2013 .

[35]  Soren Svanum,et al.  The influences of course effort, mastery and performance goals, grade expectancies, and earned course grades on student ratings of course satisfaction. , 2011, The British journal of educational psychology.

[36]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[37]  D. Gašević,et al.  “Choose Your Classmates, Your GPA Is at Stake!” , 2013 .

[38]  H. Marsh Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[39]  E. Qureshi,et al.  An Interesting Profile-University Students who Take Distance Education Courses Show Weaker Motivation Than On-Campus Students , 2002 .

[40]  Mark A. Kramer,et al.  Diagnosis using backpropagation neural networks—analysis and criticism , 1990 .

[41]  Ronen I. Brafman,et al.  Introducing Variable Importance Tradeoffs into CP-Nets , 2002, UAI.

[42]  Mykola Pechenizkiy,et al.  Process Mining Online Assessment Data , 2009, EDM.

[43]  I. E. Allen,et al.  Changing Course: Ten Years of Tracking Online Education in the United States. , 2013 .

[44]  A. Bandura Toward a Psychology of Human Agency , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[45]  R. C. Eberhart,et al.  Neural network design considerations for EEG spike detection , 1989, Proceedings of the Fifteenth Annual Northeast Bioengineering Conference.

[46]  Ruth Johnson,et al.  Students' Characteristics and Motivation Orientations for Online and Traditional Degree Programs , 2010 .

[47]  Dowming Yeh,et al.  What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction , 2008, Comput. Educ..

[48]  M. Yüksel Evaluating the Effectiveness of the Chemistry Education by Using the Analytic Hierarchy Process , 2012 .

[49]  Simon Marginson,et al.  The impossibility of capitalist markets in higher education , 2013 .

[50]  Saeed Shiry Ghidary,et al.  Prediction of student course selection in online higher education institutes using neural network , 2013, Comput. Educ..

[51]  Anthony G. Greenwald,et al.  No pain, no gain? The importance of measuring course workload in student ratings of instruction , 1997 .

[52]  Tai-Chang Hsia,et al.  Course planning of extension education to meet market demand by using data mining techniques - an example of Chinkuo technology university in Taiwan , 2008, Expert Syst. Appl..

[53]  Herbert W. Marsh,et al.  Effects of Grading Leniency and Low Workload on Students' Evaluations of Teaching: Popular Myth, Bias, Validity, or Innocent Bystanders? , 2000 .

[54]  Marc Berg,et al.  Rationalizing Medical Work: Decision-support Techniques and Medical Practices , 2022 .

[55]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[56]  Leah P. Macfadyen,et al.  Whose feedback? A multilevel analysis of student completion of end-of-term teaching evaluations , 2016 .

[57]  Alvaro Ortigosa,et al.  A Case Study: Data Mining Applied to Student Enrollment , 2010, EDM.

[58]  Yang Lin,et al.  The Research of Teaching Quality Appraisal Model Based on AHP , 2011 .

[59]  Dragan Gasevic,et al.  A Metaheuristic Approach for the Configuration of Business Process Families , 2012, 2012 IEEE Ninth International Conference on Services Computing.

[60]  Brigitte Maier,et al.  Students' expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction , 2010, Comput. Educ..

[61]  J. A. Sharp,et al.  The Analytic Hierarchy Process and its Application to an Information Technology Decision , 1990 .

[62]  Jean MacGregor,et al.  Learning Communities: Reforming Undergraduate Education , 2004 .

[63]  Wil M. P. van der Aalst,et al.  Process Mining: Overview and Opportunities , 2012, ACM Trans. Manag. Inf. Syst..

[64]  Norman Blaikie Analyzing Qualitative Data , 2003 .