The State-of-the-Art on Collective Intelligence in Online Educational Technologies

The application of the collective intelligence (CI) concept has yielded significant results in many knowledge areas and it has substantial potential to yield results in the educational context. In view of distance education and online educational technologies, the use of CI has enormous potential to improve collaboration, social learning, and problem solving. However, there is still not a clear understanding of how CI has been used in combination with online educational technologies, due to a lack of secondary studies in this context. Thus, in this article, we conducted a systematic literature review with the objectives of determining how CI has been used in online learning environments and identifying the benefits and/or the difficulties that are encountered in the process of its use. We have analyzed 354 studies and only 30 have met our inclusion criteria. The main contributions to online learning of these 30 studies were categorized and discussed. Our results have shown that CI enables the exploration. of the potential of collaboration and collaborative learning in social environments to create more diverse educational contents and to improve educational aspects using group intelligence. Moreover, approximately 74% of the studies presented positive evidence of learning benefits. However, approximately 40% of the studies also presented positive evidence of implementation difficulties. These and other results presented in this article demonstrate that more research is necessary to explore the potential of CI in online learning technologies

[1]  Ig Ibert Bittencourt,et al.  Can Ontologies Support the Gamification of Scripted Collaborative Learning Sessions? , 2020, AIED.

[2]  Julita Vassileva,et al.  GaTO: An Ontological Model to Apply Gamification in Intelligent Tutoring Systems , 2019, Front. Artif. Intell..

[3]  Aleksandra Labus,et al.  Fostering students’ participation in creating educational content through crowdsourcing , 2019, Interact. Learn. Environ..

[4]  Sara Osuna Acedo,et al.  Collaborative lifelong learning and professional transfer. Case study: ECO European Project , 2019, Interact. Learn. Environ..

[5]  Chee-Wei Tan,et al.  Human-Assisted Computation for Auto-Grading , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[6]  Aneesha Bakharia,et al.  PerspectivesX: A Collaborative Multi-perspective Elaboration Learning Tool , 2018, Smart Education and e-Learning 2018.

[7]  Eirini Takoulidou,et al.  Translation Crowdsourcing: Creating a Multilingual Corpus of Online Educational Content , 2018, LREC.

[8]  Juho Kim,et al.  ConceptScape: Collaborative Concept Mapping for Video Learning , 2018, CHI.

[9]  Amin Saberi,et al.  Creating Crowdsourced Research Talks at Scale , 2018, WWW.

[10]  L. Vaca-Cardenas,et al.  Collective Intelligence Education, Enhancing the Collaborative Learning , 2018, 2018 International Conference on eDemocracy & eGovernment (ICEDEG).

[11]  Aleksandra Klasnja-Milicevic,et al.  Social tagging strategy for enhancing e-learning experience , 2018, Comput. Educ..

[12]  Davinia Hernández Leo,et al.  Design for collective intelligence: pop-up communities in MOOCs , 2018, AI & SOCIETY.

[13]  Yunpeng Gao,et al.  Quality-Aware Crowdsourcing Curriculum Recommendation in MOOCs , 2017, DASFAA Workshops.

[14]  Bo Liu,et al.  Crowdsourcing Based Teaching Assistant Arrangement for MOOC , 2017, DASFAA Workshops.

[15]  Ig Ibert Bittencourt,et al.  Does peer assessment in on-line learning environments work? A systematic review of the literature , 2016, Computers in Human Behavior.

[16]  Chengjie Sun,et al.  Thread Structure Prediction for MOOC Discussion Forum , 2016, ICYCSEE.

[17]  Aditya Kamath,et al.  A crowdsourced approach to student engagement recognition in e-learning environments , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[18]  Araz Taeihagh,et al.  MOOCs and Crowdsourcing: Massive Courses and Massive Resources , 2015, First Monday.

[19]  Jaime Meza,et al.  Fostering Collective Intelligence Education , 2015, eLEOT.

[20]  Andrew Olney,et al.  Authoring Intelligent Tutoring Systems Using Human Computation: Designing for Intrinsic Motivation , 2015, HCI.

[21]  Neil T. Heffernan,et al.  Connecting Collaborative & Crowd Work with Online Education , 2015, CSCW Companion.

[22]  Fatos Xhafa,et al.  A Collective Intelligence Approach for Building Student's Trustworthiness Profile in Online Learning , 2014, 2014 Ninth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[23]  Edward Cutrell,et al.  VidWiki: enabling the crowd to improve the legibility of online educational videos , 2014, CSCW.

[24]  Giner Alor-Hernández,et al.  Collective intelligence as mechanism of medical diagnosis: The iPixel approach , 2013, Expert Syst. Appl..

[25]  Luis von Ahn Duolingo: learn a language for free while helping to translate the web , 2013, IUI '13.

[26]  Jun Jo,et al.  A Quality Control Model for Trustworthy Crowdsourcing in Collaborative Learning , 2013, RiTA.

[27]  Federico González,et al.  Procesos de inteligencia colectiva y colaborativa en el marco de tecnologías web 2.0: conceptos, problemas y aplicaciones , 2012 .

[28]  Jinhua She,et al.  Construction of a personally adapted e-learning system using collective intelligence , 2012, 2012 15th International Conference on Interactive Collaborative Learning (ICL).

[29]  Chris Callison-Burch,et al.  Crowdsourcing Translation: Professional Quality from Non-Professionals , 2011, ACL.

[30]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[31]  Wei-Tek Tsai,et al.  Collaborative Learning Using Wiki Web Sites for Computer Science Undergraduate Education: A Case Study , 2011, IEEE Transactions on Education.

[32]  Santiago Martín,et al.  Collaborative web learning tools: Wikis and blogs , 2010, Comput. Appl. Eng. Educ..

[33]  Chrysanthos Dellarocas,et al.  The collective intelligence genome , 2010 .

[34]  Jose Salazar,et al.  Staying Connected: Online Education Engagement and Retention using Educational Technology Tools , 2010, American Society for Clinical Laboratory Science.

[35]  Hui Li,et al.  Emergence of collective intelligence in distance education system , 2010, 2010 2nd International Conference on Education Technology and Computer.

[36]  Dawn G. Gregg Developing a collective intelligence application for special education , 2009, Decis. Support Syst..

[37]  Manuel Blum,et al.  reCAPTCHA: Human-Based Character Recognition via Web Security Measures , 2008, Science.

[38]  Esma Aïmeur,et al.  Harnessing Learner's Collective Intelligence: A Web2.0 Approach to E-Learning , 2008, Intelligent Tutoring Systems.

[39]  Stephen W. Liddle,et al.  Web 2.0 Learning Platform: Harnessing Collective Intelligence. , 2007 .

[40]  Ann Majchrzak,et al.  Enabling Customer-Centricity Using Wikis and the Wiki Way , 2006, J. Manag. Inf. Syst..

[41]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[42]  Pierre Lévy,et al.  Collective Intelligence: Mankind's Emerging World in Cyberspace , 1997 .

[43]  D. Davis,et al.  Delft University of Technology Evaluating Crowdworkers as a Proxy for Online Learners in Video-Based Learning Contexts , 2018 .

[44]  Barbara McGillivray,et al.  Everything you always wanted to know about dictionaries (but were afraid to ask): A Massive Open Online Course , 2018 .

[45]  Nian-Shing Chen,et al.  An Embodied Design with Collective Intelligence for Creating Interactive Video Lectures , 2016 .

[46]  L. Hunter Lovins,et al.  A World That Works for All , 2014 .

[47]  Ali Khalili,et al.  CrowdLearn: Crowd-sourcing the Creation of Highly-structured e-Learning Content , 2013, CSEDU.

[48]  Ramjee Prasad,et al.  Technology-enabled social learning: a review , 2011, Int. J. Knowl. Learn..

[49]  Pierre Lévy,et al.  From social computing to reflexive collective intelligence: The IEML research program , 2010, Inf. Sci..

[50]  Ingrid Paus-Hasebrink,et al.  Opportunities of Web 2.0: Potentials of learning , 2010 .

[51]  J. Leimeister Collective Intelligence , 2010, Bus. Inf. Syst. Eng..

[52]  E. Bonabeau Decisions 2.0: the power of collective intelligence , 2009 .

[53]  Pierre Dillenbourg,et al.  The Evolution of Research on Computer-Supported Collaborative Learning , 2009 .

[54]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[55]  Zhiting Zhu,et al.  A Learning Framework for Knowledge Building and Collective Wisdom Advancement in Virtual Learning Communities , 2007, J. Educ. Technol. Soc..

[56]  Tom Routen,et al.  Intelligent Tutoring Systems , 1996, Lecture Notes in Computer Science.

[57]  C. Chabris,et al.  Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2010, Science.