Classsourcing: Crowd-Based Validation of Question-Answer Learning Objects

The Web 2.0 principles reflect into learning domain and provide means for interactivity and collaboration. Student activities during learning in this environment can be utilized to gather data usable for learning corpora enrichment. It is now a research issue to examine, to what extent the student crowd is reliable in delivering useful artifacts and to bring in suitable tools to enable this. In this paper we present a method for crowd-based validation of question-answer learning objects involving interactive exercise for learners. The method utilizes students' correctness estimations of answers provided by other students during learning. We show that aggregate student crowd estimations are to big extent comparable to teacher's evaluations of provided answers.

[1]  Daniel D. Suthers,et al.  Computer-supported collaborative learning: An historical perspective , 2006 .

[2]  Pernilla Qvarfordt,et al.  Collaborative Information Seeking , 2009, Computer.

[3]  Nicholas Reynolds,et al.  Key Competencies in the Knowledge Society - IFIP TC 3 International Conference, KCKS 2010, Held as Part of WCC 2010, Brisbane, Australia, September 20-23, 2010. Proceedings , 2010, Key Competencies in the Knowledge Society.

[4]  Dwight Allen,et al.  Student-authored Wikibooks: Textbooks of the Future? , 2008 .

[5]  Mária Bieliková,et al.  Supporting Collaborative Web-based Education via Annotations , 2011 .

[6]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[7]  Brandon Muramatsu,et al.  Draft Standard for Learning Object Metadata , 2002 .

[8]  Gary Marchionini,et al.  Information-Seeking Support Systems [Guest Editors' Introduction] , 2009, Computer.

[9]  Anirban Dasgupta,et al.  Vote calibration in community question-answering systems , 2012, SIGIR '12.

[10]  Stephen Downes.  E-learning 2.0 , 2005, ELERN.

[11]  Nor Aniza Abdullah,et al.  The Effect of Incorporating Good Learners' Ratings in e-Learning Content-based Recommender System , 2011, J. Educ. Technol. Soc..

[12]  R. Sawyer.  The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[13]  Steve Wheeler,et al.  The good, the bad and the wiki: Evaluating student-generated content for collaborative learning , 2008, Br. J. Educ. Technol..

[14]  Gilad Mishne,et al.  Finding high-quality content in social media , 2008, WSDM '08.

[15]  Mária Bieliková,et al.  ALEF: A Framework for Adaptive Web-Based Learning 2.0 , 2010, Key Competencies in the Knowledge Society.

[16]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.