Case-Based Recommendation for Online Judges Using Learning Itineraries

Online judges are online repositories with hundreds or thousands of programming exercises or problems. They are very interesting tools for learning programming concepts, but novice users tend to feel overwhelmed by the large number of problems available. Traditional recommendation techniques based on content or collaborative filtering do not work well in these systems due to the lack of user ratings or semantic descriptions of the problems. In this work, we propose a recommendation approach based on learning itineraries, i.e., the sequences of problems that the users tried to solve. Our experiments reveal that interesting learning paths can emerge from previous user experiences and we can use those learning paths to recommend interesting problems to new users. We also show that the recommendation can be improved if we consider not only the problems but also the order in which they were solved.

[1]  Paulo Alves,et al.  Case-Based Reasoning Approach to Adaptive Web-Based Educational Systems , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[2]  Osmar R. Za ¨ õane Building a Recommender Agent for e-Learning Systems , 2002 .

[3]  Pedro Pablo Gómez-Martín,et al.  Similarity Metrics from Social Network Analysis for Content Recommender Systems , 2016, ICCBR.

[4]  Alan Said,et al.  Comparative recommender system evaluation: benchmarking recommendation frameworks , 2014, RecSys '14.

[5]  Robert P. Goldman,et al.  Measuring Plan Diversity: Pathologies in Existing Approaches and A New Plan Distance Metric , 2015, AAAI.

[6]  Ioana Hulpus,et al.  A Framework for Personalised Learning-Plan Recommendations in Game-Based Learning , 2014, Recommender Systems for Technology Enhanced Learning.

[7]  Michael J. Pazzani,et al.  A Framework for Collaborative, Content-Based and Demographic Filtering , 1999, Artificial Intelligence Review.

[8]  Andrew Lim,et al.  Online Judge , 2001, Comput. Educ..

[9]  Mercedes Gómez-Albarrán,et al.  A Semantically Enriched Context-Aware OER Recommendation Strategy and Its Application to a Computer Science OER Repository , 2014, IEEE Transactions on Education.

[10]  Katrien Verbert,et al.  Panorama of Recommender Systems to Support Learning , 2015, Recommender Systems Handbook.

[11]  Simon Dooms,et al.  Recommender systems challenge 2014 , 2014, RecSys '14.

[12]  M. Levandowsky,et al.  Distance between Sets , 1971, Nature.

[13]  Umberto Straccia,et al.  User recommendation for collaborative and personalised digital archives , 2005, Int. J. Web Based Communities.

[14]  Toon De Pessemier,et al.  A Framework for Dataset Benchmarking and Its Application to a New Movie Rating Dataset , 2016, ACM Trans. Intell. Syst. Technol..

[15]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[16]  Rob Nadolski,et al.  Effects of the ISIS Recommender System for Navigation Support in self-organised Learning Networks , 2009, J. Educ. Technol. Soc..