Learnersourcing Personalized Hints

Personalized support for students is a gold standard in education, but it scales poorly with the number of students. Prior work on learnersourcing presented an approach for learners to engage in human computation tasks while trying to learn a new skill. Our key insight is that students, through their own experience struggling with a particular problem, can become experts on the particular optimizations they implement or bugs they resolve. These students can then generate hints for fellow students based on their new expertise. We present workflows that harvest and organize students' collective knowledge and advice for helping fellow novices through design problems in engineering. Systems embodying each workflow were evaluated in the context of a college-level computer architecture class with an enrollment of more than two hundred students each semester. We show that, given our design choices, students can create helpful hints for their peers that augment or even replace teachers' personalized assistance, when that assistance is not available.

[1]  Arthur C. Graesser,et al.  Design Recommendations for Intelligent Tutoring Systems: Volume 4-Domain Modeling , 2016 .

[2]  Lydia Kavanagh,et al.  Reflecting on Reflection - 10 years, Engineering, and UQ , 2008 .

[3]  K. Koedinger,et al.  Using Intelligent Tutor Technology to Implement Adaptive Support for Student Collaboration , 2010 .

[4]  J. Dewey.  How we think : a restatement of the relation of reflective thinking to the educative process , 1934 .

[5]  Eric Mazur,et al.  Peer Instruction: A User's Manual , 1996 .

[6]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[7]  Neil Salkind,et al.  Encyclopedia of educational psychology , 2008 .

[8]  Scott R. Klemmer,et al.  Community TAs scale high-touch learning, provide student-staff brokering, and build esprit de corps , 2014, L@S.

[9]  Scott R. Klemmer,et al.  What would other programmers do: suggesting solutions to error messages , 2010, CHI.

[10]  K. Topping.  Peer Assessment Between Students in Colleges and Universities , 1998 .

[11]  Piotr Mitros,et al.  Learnersourcing of Complex Assessments , 2015, L@S.

[12]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[13]  Michael S. Bernstein,et al.  Talkabout: Making Distance Matter with Small Groups in Massive Classes , 2015, CSCW.

[14]  Krzysztof Z. Gajos,et al.  Learnersourcing Subgoal Labels for How-to Videos , 2015, CSCW.

[15]  Krzysztof Z. Gajos,et al.  Learnersourcing subgoal labeling to support learning from how-to videos , 2013, CHI Extended Abstracts.

[16]  B. Bloom.  The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[17]  L. Vygotsky.  Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[18]  Tuğrul Yürük,et al.  Kitap, Tez, Sempozyum Değerlendirmeleri / John Dewey, How We Think, A Restatement of The Relation of Reflective Thinking to The Educative Process, D. C. Heath and Company, 1933, 10+301 s. , 2007 .

[19]  Carolyn Penstein Rosé,et al.  Tutorial Dialogue as Adaptive Collaborative Learning Support , 2007, AIED.

[20]  C. Atman,et al.  Integrating Reflection into Engineering Education , 2014 .

[21]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[22]  Peter Brusilovsky.  Domain Modeling for Personalized Guidance , 2016 .

[23]  A. Graesser,et al.  Confusion can be beneficial for learning. , 2014 .

[24]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[25]  Björn Hartmann,et al.  Should your MOOC forum use a reputation system? , 2014, CSCW.