Smart Recommendation for an Evolving E-Learning System: Architecture and Experiment

In this article, we proposed an evolving e-learning system which can adapt itself both to the learners and to the open Web, and we pointed out the differences of making recommendations in e-learning and other domains. We propose two pedagogy features in recommendation: learner interest and background knowledge. A description of a paper's value, similarity, and ordering are presented using formal definitions. We also study two pedagogy-oriented recommendation techniques: content-based and hybrid recommendations. We argue that while it is feasible to apply both of these techniques in our domain, a hybrid collaborative filtering technique is more efficient to make "just-in-time" recommendations. In order to assess and compare these two techniques, we carried out an experiment using artificial learners. Experiment results are encouraging, showing that hybrid collaborative filtering, which can lower the computational costs, will not compromise the overall performance of the recommendation system. In addition, as more and more learners participate in the learning process, both learner and paper models can better be enhanced and updated, which is especially desirable for webbased learning systems. We have tested the recommendation mechanisms with real learners, and the results are very encouraging.

[1]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[2]  Licia Calvi,et al.  AHA! An open Adaptive Hypermedia Architecture , 1998, New Rev. Hypermedia Multim..

[3]  John Riedl,et al.  Analysis of recommendation algorithms for e-commerce , 2000, EC '00.

[4]  Hector Garcia-Molina,et al.  Efficient Crawling Through URL Ordering , 1998, Comput. Networks.

[5]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.

[6]  Craig D. B. Boyle,et al.  Metadoc: An adaptive hypertext reading system , 1994, User Modeling and User-Adapted Interaction.

[7]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[8]  Filippo Menczer,et al.  Evaluating topic-driven web crawlers , 2001, SIGIR '01.

[9]  G. McCalla,et al.  Mining Implicit Ratings for Focused Collaborative Filtering for Paper Recommendations , 2003 .

[10]  Mia Stern,et al.  Adaptive Content in an Online Lecture System , 2000, AH.

[11]  Yoav Shoham,et al.  Fab: content-based, collaborative recommendation , 1997, CACM.

[12]  Carla E. Brodley,et al.  KDD-Cup 2000 organizers' report: peeling the onion , 2000, SKDD.

[13]  William W. Cohen,et al.  Recommendation : A Study in Combining Multiple Information Sources , 2007 .

[14]  Gordon I. McCalla,et al.  Student modeling for a web-based learning environment: a data mining approach , 2002, AAAI/IAAI.

[15]  KobsaAlfred User Modeling and User-Adapted Interaction , 2005 .

[16]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[17]  Arthur Baskin,et al.  Learning companion systems , 1989 .

[18]  Alfred Kobsa,et al.  Personalised hypermedia presentation techniques for improving online customer relationships , 2001, The Knowledge Engineering Review.

[19]  Craig D. B. Boyle,et al.  Metadoc: An Adaptive Hypertext Reading System , 1994 .

[20]  James Chen,et al.  Adaptive hypertext navigation based on user goals and context , 1993, User Modeling and User-Adapted Interaction.

[21]  Matjaz Debevc,et al.  An adaptive short list for documents on the World Wide Web , 1997, IUI '97.

[22]  Gordon I. McCalla,et al.  Laws of Attraction: In Search of Document Value-ness for Recommendation , 2004, ECDL.

[23]  G. McCalla The Fragmentation of Culture , Learning , Teaching and Technology : Implications for the Artificial Intelligence in Education Research Agenda in 2010 , 2000 .

[24]  T. Joachims WebWatcher : A Tour Guide for the World Wide Web , 1997 .

[25]  Gordon I. McCalla,et al.  Utilizing Artificial Learners to Help Overcome the Cold-Start Problem in a Pedagogically-Oriented Paper Recommendation System , 2004, AH.

[26]  Allison Woodruff,et al.  Enhancing a digital book with a reading recommender , 2000, CHI.

[27]  C. Lee Giles,et al.  A system for automatic personalized tracking of scientific literature on the Web , 1999, DL '99.

[28]  Douglas Cunliffe Daniel Tudhope,et al.  The New Review of Hypermedia and Multimedia , 1995 .

[29]  Mia Stern,et al.  Curriculum Sequencing in a Web-Based Tutor , 1998, Intelligent Tutoring Systems.

[30]  Marco Gori,et al.  Focused Crawling Using Context Graphs , 2000, VLDB.

[31]  Riccardo Rizzo,et al.  Map-based horizontal navigation in educational Hypertext , 2002, HYPERTEXT '02.

[32]  C. Lee Giles,et al.  Clustering and identifying temporal trends in document databases , 2000, Proceedings IEEE Advances in Digital Libraries 2000.

[33]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[34]  Loren G. Terveen,et al.  Does “authority” mean quality? predicting expert quality ratings of Web documents , 2000, SIGIR '00.

[35]  Sebastiano Pizzutilo,et al.  User tailored hypermedia explanations , 1993, INTERCHI Adjunct Proceedings.

[36]  Andreas Paepcke,et al.  Beyond document similarity: understanding value-based search and browsing technologies , 2000, SGMD.

[37]  Gordon I. McCalla,et al.  On the Pedagogically Guided Paper Recommendation for an Evolving Web-Based Learning System , 2004, FLAIRS Conference.

[38]  Peter Pirolli,et al.  Life, death, and lawfulness on the electronic frontier , 1997, CHI.

[39]  Martin van den Berg,et al.  Focused Crawling: A New Approach to Topic-Specific Web Resource Discovery , 1999, Comput. Networks.

[40]  Filippo Menczer,et al.  Adaptive Retrieval Agents: Internalizing Local Context and Scaling up to the Web , 2000, Machine Learning.

[41]  Platform Symphony,et al.  Smart recommendation for an evolving e-learning system: architecture and experiment. , 2007 .

[42]  Keith C. C. Chan,et al.  Feature Construction for Student Group Forming Based on Their Browsing Behaviors in an E-learning System , 2002, PRICAI.

[43]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[44]  Ron Kohavi,et al.  Applications of Data Mining to Electronic Commerce , 2000, Springer US.

[45]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[46]  Sean M. McNee,et al.  On the recommending of citations for research papers , 2002, CSCW '02.

[47]  Raymond J. Mooney,et al.  Content-boosted collaborative filtering for improved recommendations , 2002, AAAI/IAAI.

[48]  M. Pazzani,et al.  Webert : Identifying interesting web sites , 2022 .

[49]  Michael J. Pazzani,et al.  A hybrid user model for news story classification , 1999 .

[50]  Mimi Recker,et al.  What do you recommend? Implementation and analyses of collaborative information filtering of web resources for education , 2003 .

[51]  William W. Cohen,et al.  Recommendation as Classification: Using Social and Content-Based Information in Recommendation , 1998, AAAI/IAAI.

[52]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.