Using Collaborative Filtering Algorithms as eLearning Tools

Collaborative information filtering techniques play a key role in many Web 2.0 applications. While they are currently mainly used for business purposes such as product recommendation, collaborative filtering also has potential for usage in eLearning applications. The quality of a student provided solution can be heuristically determined by peers who review the solution, thus effectively disburdening the workload of tutors. This paper presents a collaborative filtering approach which is specifically designed for eLearning applications. A controlled lab study with the system confirmed that the underlying algorithm is suitable as a diagnostic tool: The system-generated quality heuristic correlated highly with an expert-provided manual grading of the student solutions. This was true independent of whether the students provided fine-grained or coarsegrained evaluations of peer solutions, and independent of the task type that the students worked on. Further, the system required only few peer evaluations in order to achieve an acceptable prediction quality.

[1]  L. Stefani.  Peer, self and tutor assessment: Relative reliabilities , 1994 .

[2]  Pamela J. Hinds,et al.  The curse of expertise: The effects of expertise and debiasing methods on prediction of novice performance. , 1999 .

[3]  Vincent Aleven,et al.  Toward Legal Argument Instruction with Graph Grammars and Collaborative Filtering Techniques , 2006, Intelligent Tutoring Systems.

[4]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[5]  Edward F. Gehringer,et al.  Strategies and mechanisms for electronic peer review , 2000, 30th Annual Frontiers in Education Conference. Building on A Century of Progress in Engineering Education. Conference Proceedings (IEEE Cat. No.00CH37135).

[6]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[7]  W. Terry Dancer,et al.  Peer Rating in Higher Education , 1992 .

[8]  Edward F. Gehringer,et al.  Electronic peer review and peer grading in computer-science courses , 2001, SIGCSE '01.

[9]  Christian D. Schunn,et al.  Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system , 2007, Comput. Educ..

[10]  Christian D. Schunn,et al.  Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives , 2006 .

[11]  Mimi Recker,et al.  Collaborative Information Filtering: A Review and an Educational Application , 2004, Int. J. Artif. Intell. Educ..

[12]  Vincent Aleven,et al.  Defining "Ill-Defined Domains"; A literature survey. , 2006 .

[13]  Vincent Aleven,et al.  Evaluating Legal Argument Instruction with Graphical Representations Using LARGO , 2007, AIED.

[14]  Brian P. Mathews,et al.  Assessing Individual Contributions: Experience of Peer Evaluation in Major Group Projects , 1994, Br. J. Educ. Technol..