Building an evaluation framework for social media-enabled collaborative learning environments (SMECLEs)

Social media is an emerging topic in information systems (IS) research, but has quickly been adopted by practice in many areas including marketing, finance and customer service. Another area seeing increased adoption is learning, where social media platforms are being appropriated to build collaborative learning environments, which can be referred to as social media-enabled collaborative learning environments (SMECLE). However, it is not evident whether these social media platforms can enable collaborative learning; therefore, the purpose of this research is to build an evaluation framework to explore whether social media platforms enable collaborative learning. To achieve this, the paper identifies the social media and collaborative learning constructs that are necessary to build such an evaluation framework. Finally, three illustrative examples of how to utilise the evaluation framework are presented, further exposing the rules of its use. The framework is of value to educators who may be deciding to develop SMECLEs or want to provide themselves an appropriate means of evaluating the effectiveness of social media platforms in enabling collaborative learning.

[1]  Dag H. Olsen,et al.  Educating reflective Enterprise Systems practitioners: a design research study of the iterative building of a teaching framework , 2014, Inf. Syst. J..

[2]  Ian Patrick McLoughlin,et al.  A Social Informatics Perspective , 2013 .

[3]  David Godes,et al.  Introduction to the Special Issue - Social Media and Business Transformation: A Framework for Research , 2013, Inf. Syst. Res..

[4]  Rainer Alt,et al.  Web 2.0 applications in private banking - classification, potentials, and application fields , 2011, ECIS.

[5]  Linda Askenäs,et al.  Wiki collaboration in organizations: an explorartory study , 2011, ECIS.

[6]  Tadhg Nagle,et al.  The impact of social network sites on the consumption of cultural goods , 2011, ECIS.

[7]  Oded Nov,et al.  Information Quality in Wikipedia: The Effects of Group Composition and Task Conflict , 2011, J. Manag. Inf. Syst..

[8]  Analía Amandi,et al.  Personalised collaborative skills for student models , 2011, Interact. Learn. Environ..

[9]  Viswanath Venkatesh,et al.  Predicting Collaboration Technology Use: Integrating Technology Adoption and Collaboration Research , 2010, J. Manag. Inf. Syst..

[10]  Steven H. Hanks,et al.  The 2020 Workplace: How Innovative Companies Attract, Develop, and Keep Tomorrow's Employees Today , 2010 .

[11]  Martin Ebner,et al.  Microblogs in Higher Education - A chance to facilitate informal and process-oriented learning? , 2010, Comput. Educ..

[12]  David Hinds,et al.  Engaging Group E-Learning in Virtual Worlds , 2009, J. Manag. Inf. Syst..

[13]  Elaine Ferneley,et al.  Research 2.0: Improving participation in online research communities , 2009, ECIS.

[14]  Nannette P. Napier,et al.  IT project managers' construction of successful project management practice: a repertory grid investigation , 2009, Inf. Syst. J..

[15]  Qiyun Wang,et al.  Designing a web-based constructivist learning environment , 2009, Interact. Learn. Environ..

[16]  Gerald C. Kane,et al.  The Shoemaker's Children: Using Wikis for Information Systems Teaching, Research, and Publication , 2009, MIS Q..

[17]  Vincent S. Lai,et al.  Factors in the Global Assimilation of Collaborative Information Technologies: An Exploratory Investigation in Five Regions , 2008, J. Manag. Inf. Syst..

[18]  Ann Majchrzak,et al.  Enabling Customer-Centricity Using Wikis and the Wiki Way , 2006, J. Manag. Inf. Syst..

[19]  Luke Tredinnick Web 2.0 and Business , 2006 .

[20]  Huaiqing Wang,et al.  A conceptual model of personalized virtual learning environments , 2005, Expert Syst. Appl..

[21]  Karen Neville,et al.  A case in customizing e-learning , 2005, J. Inf. Technol..

[22]  Vincent S. Lai,et al.  The adoption and use of collaboration information technologies: international comparisons , 2005, J. Inf. Technol..

[23]  Ilan Oshri,et al.  Social ties, knowledge sharing and successful collaboration in globally distributed system development projects , 2005, Eur. J. Inf. Syst..

[24]  L. Chidambaram,et al.  A Capabilities-Based Theory of Technology Deployment in Diverse Teams: Leapfrogging the Pitfalls of Diversity and Leveraging Its Potential with Collaborative Technology , 2004, J. Assoc. Inf. Syst..

[25]  Nigel P. Melville,et al.  Review: Information Technology and Organizational Performance: An Integrative Model of IT Business Value , 2004, MIS Q..

[26]  Marshall Scott Poole,et al.  Interpersonal Traits, Complementarity, and Trust in Virtual Collaboration , 2004, J. Manag. Inf. Syst..

[27]  Carol Stoak Saunders,et al.  The Social Construction of Meaning: An Alternative Perspective on Information Sharing , 2003, Inf. Syst. Res..

[28]  Youngjin Yoo,et al.  A Comparative Study of Distributed Learning Environments on Learning Outcomes , 2002, Inf. Syst. Res..

[29]  Ron Chi-Wai Kwok,et al.  Role of GSS on collaborative problem-based learning: a study on knowledge externalisation , 2002, Eur. J. Inf. Syst..

[30]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[31]  Theodore Panitz,et al.  Collaborative versus Cooperative Learning: A Comparison of the Two Concepts Which Will Help Us Understand the Underlying Nature of Interactive Learning. , 1999 .

[32]  Douglas R. Vogel,et al.  Consensus and Perceived Satisfaction Levels: A Cross-Cultural Comparison of GSS and Non-GSS Outcomes within and between the United States and Mexico , 1996, J. Manag. Inf. Syst..

[33]  Lynda O'Mahony,et al.  Group problem solving and decision making: an investigation of the process and the supporting technology , 1996, J. Inf. Technol..

[34]  Sirkka L. Jarvenpaa,et al.  The Use of Information Technology to Enhance Management School Education: A Theoretical View , 1995, MIS Q..

[35]  Joseph S. Valacich,et al.  Using IT to Reengineer Business Education: An Exploratory Investigation of Collaborative Telelearning , 1995, MIS Q..

[36]  J. Cooper,et al.  Building Bridges Between Cooperative and Collaborative Learning , 1995 .

[37]  K. Bruffee Collaborative Learning: Higher Education, Interdependence, and the Authority of Knowledge , 1995 .

[38]  Maryam Alavi,et al.  Computer-Mediated Collaborative Learning: An Empirical Evaluation , 1994, MIS Q..

[39]  Sirkka L. Jarvenpaa,et al.  The Information Age Confronts Education: Case Studies on Electronic Classrooms , 1993, Inf. Syst. Res..

[40]  Lorne Olfman,et al.  The Importance of Learning Style in End-User Training , 1990, MIS Q..

[41]  Gerardine DeSanctis,et al.  Using a GDSS to Facilitate Group Consensus: Some Intended and Unintended Consequences , 1988, MIS Q..

[42]  Keng Siau,et al.  International Conference on Information Systems ( ICIS ) 2010 3-D VIRTUAL WORLD EDUCATION : AN EMPIRICAL COMPARISON WITH FACE-TO-FACE CLASSROOM , 2017 .

[43]  Erwin Fielt,et al.  European Conference on Information Systems ( ECIS ) Summer 10-6-2011 A SYSTEMATIC , TOOL-SUPPORTED METHOD FOR CONDUCTING LITERATURE REVIEWS IN INFORMATION SYSTEMS , 2017 .

[44]  Sergio Vasquez Bronfman,et al.  European Conference on Information Systems ( ECIS ) 1-12000 Linking Information Technology and Pedagogical Innovation to Enhance Management Education , 2013 .

[45]  Xuesong Zhang,et al.  Design and Evaluation of a Socially Enhanced Classroom Blog to Promote Student Learning in Higher Education , 2012, AMCIS.

[46]  Souren Paul,et al.  Social Networks: Cultural Diversity, Trust, Reciprocity and Social Capital , 2012, AMCIS.

[47]  Jehad Imlawi,et al.  Engagement in Online Communities: the Impact of Self-Disclosure and Humor , 2012, AMCIS.

[48]  Christoph Rosenkranz,et al.  Increasing the Willingness to Collaborate Online: an Analysis of Sentiment-Driven Interactions in Peer Content Production , 2011, ICIS.

[49]  Meri Kuikka,et al.  Determining the challenges of organizational social media adoption and use , 2011, ECIS.

[50]  Alexander Richter,et al.  What are you doing? - enterprise microblogging as context building , 2011, ECIS.

[51]  Sebastian Köhler,et al.  Automatic Reputation Assessment in Wikipedia , 2011, ICIS.

[52]  Sven Laumer,et al.  Dispositional resistance to change and social network site adopters' and non-adopters' attitudinal beliefs - an empirical analysis , 2011, ECIS.

[53]  Rajesh Vasa,et al.  Leveraging emerging web technologies for community engagement project success in higher education , 2011, ECIS.

[54]  Ravi Thambusamy,et al.  A Sociomateriality Practice Perspective of Online Social Networking , 2011, ICIS.

[55]  Ling Zhu,et al.  Understanding Continuance Usage of Social Networking Services: A Theoretical Model and Empirical Study of the Chinese Context , 2011, ICIS.

[56]  R. Watson,et al.  THE VALUE OF SOCIAL MEDIA: TOWARD MEASURING SOCIAL MEDIA STRATEGIES , 2011 .

[57]  Nandish V. Patel,et al.  There is no longer one truth!: corporate communications and social media management through deferred systems , 2011, ECIS.

[58]  Jo Hanisch,et al.  Social media and organisation policy (someop): finding the perfect balance , 2011, ECIS.

[59]  Daniel Richter,et al.  Social media marketing on multiple services - the case of the student run organisation aiesec , 2011, ECIS.

[60]  A. Kaplan,et al.  Users of the world, unite! The challenges and opportunities of Social Media , 2010 .

[61]  Michael Chau,et al.  Friend Suggestion and Friend Browsing in Web 2.0 Applications , 2010, AMCIS.

[62]  Anne Beaudry,et al.  Understanding Individual Adoption and Use of Social Computing: a User-System Fit Model and Empirical Study , 2010, ICIS.

[63]  DongBack Seo,et al.  A Way to Become Enterprise 2.0: beyond Web 2.0 Tools , 2010, ICIS.

[64]  Richard Boateng,et al.  Web 2.0 and Organizational Learning: Conceptualizing the Link , 2009, AMCIS.

[65]  Nitin Aggarwal,et al.  Leveraging Relationships with Web 2.0 Consumer Communities as a Strategic Capability , 2009, AMCIS.

[66]  Ying Zhang,et al.  A 'uses and gratifications' approach to understanding the role of wiki technology in enhancing teaching and learning outcomes , 2009, ECIS.

[67]  Dorit Nevo,et al.  Identifying Social Computing Dimensions: A Multidimensional Scaling Study , 2009, ICIS.

[68]  Zhaoli Meng,et al.  Knowledge sharing in online communities , 2009, ECIS.

[69]  Dick Stenmark,et al.  Web 2.0 in the Business Environment: The New Intranet or a Passing Hype? , 2008, ECIS.

[70]  Cora D. Schaefer Motivations and Usage Patterns on Social Network Sites , 2008, ECIS.

[71]  R. Hartshorne,et al.  Investigating faculty decisions to adopt Web 2.0 technologies: Theory and empirical tests , 2008, Internet High. Educ..

[72]  Venugopal Balijepally,et al.  Learning Effectiveness and Student Satisfication in Mobile Classrooms , 2008, AMCIS.

[73]  Victor Kaptelinin,et al.  Group Cognition Computer Support for Building Collaborative Knowledge , 2007 .

[74]  Mikko T. Siponen,et al.  A Critical Assessment of IS Security Research between 1990-2004 , 2007, ECIS.

[75]  Pnina Shachaf,et al.  Web 2.0: A Social Informatics Perspective , 2007, AMCIS.

[76]  Helen Hasan,et al.  Democratising Organisational Knowledge: The Potential of the Corporate Wiki , 2007, ICIS.

[77]  Graham Vickery,et al.  Participative Web And User-Created Content: Web 2.0 Wikis and Social Networking , 2007 .

[78]  Anita Greenhill,et al.  Myth-making as social exchange: Organizing a web-based community , 2006, ECIS.

[79]  Inka Vilpola,et al.  Usability of a Virtual Learning Environment Concerning Safety at Work. , 2004 .

[80]  Mahnaz Moallem,et al.  Applying Constructivist and Objectivist Learning Theories in the Design of A Web-Based Course: Implications for Practice , 2001, J. Educ. Technol. Soc..

[81]  Paul A. Kirschner,et al.  Using integrated electronic environments for collaborative teaching/learning , 2001 .

[82]  Anne C. Rouse,et al.  AIS Electronic Library (AISeL) , 2000 .

[83]  Mark A. Fuller,et al.  Facilitator Influence in Group Support Systems: Intended and Unintended Effects , 1998, Inf. Syst. Res..

[84]  P. Dillenbourg,et al.  The evolution of research on collaborative learning , 1996 .

[85]  Anne S. Goodsell Collaborative Learning: A Sourcebook for Higher Education. , 1992 .

[86]  Harvey S. Wiener,et al.  Collaborative Learning in the Classroom: A Guide to Evaluation. , 1986 .