Instant messenger-based online discourse platform and its impacts on students' academic performances: An exploratory study in art and design education

As an alternative approach to traditional classroom-based learning environment, an online platform based on instant messenger (IM) is developed for subgroup discourses of Principles of Art Pattern Design (PAPD), one of the basic courses in art and design education. To quantify its effects on students' academic performances, the unified final test, including a standardized exam and an artwork rating, was administered to students enrolled in this study. The exam score, rating score, and their association were used as indicators to measure students' knowledge, skills, and abilities (KSA) of art pattern design, respectively. Because this study adopted multilevel hierarchical study design, linear mixed models were employed to evaluate the effects of IM-based online discourse on students' KSA at three levels - TEACHER-, CLASS- and STUDENT-level. Compared with classroom-based face-to-face discourse, IM-based online discourse slightly lowered students' performances on average. However, the effects of IM-based online discourse on students' KSA varied with different levels, and were inconsistently inferior to those of classroom-based face-to-face discourse. Considered the complex processes of teaching and learning involved, therefore, IM-based discourse platform should learn from the strengths of traditional classroom-based learning environment to further upgrade, and be thoroughly examined under different conditions. We designed an instant messenger (IM)-based platform for Art Pattern Design (PAPD).We quantify the effects of this platform at TEACHER-, CLASS- and STUDENT-level.The effects of IM-based discourse on students' KSA varied with different levels.IM-based discourse was inconsistently inferior to classroom-based discourse.

[1]  Robin Mason,et al.  e-Learning and Social Networking Handbook: Resources for Higher Education , 2008 .

[2]  Shawn M. Glynn,et al.  Capturing Readers' Attention by Means of Typographical Cuing Strategies. , 1978 .

[3]  Albert D. Ritzhaupt,et al.  Cases on Educational Technology Implementation for Facilitating Learning , 2013 .

[4]  Margaret K. Koenigs,et al.  Teachers and Student Achievement in the Chicago Public High Schools , 2003 .

[5]  Robert Kail,et al.  Human Development: A Life-Span View , 1999 .

[6]  Ludger Woessmann,et al.  The Impact of Teacher Subject Knowledge on Student Achievement: Evidence from Within-Teacher Within-Student Variation , 2010, SSRN Electronic Journal.

[7]  Brian J. Ruggeberg,et al.  DOING COMPETENCIES WELL: BEST PRACTICES IN COMPETENCY MODELING , 2011 .

[8]  Gregoris Mentzas,et al.  Competency based management: a review of systems and approaches , 2006, Inf. Manag. Comput. Secur..

[9]  F. Coit Butler,et al.  The Concept of Competence: An Operational Definition. , 1978 .

[10]  J. Allen,et al.  Observations of Effective Teacher–Student Interactions in Secondary School Classrooms: Predicting Student Achievement With the Classroom Assessment Scoring System—Secondary , 2013, School psychology review.

[11]  Robert M. Bernard,et al.  A Meta-Analysis of Three Types of Interaction Treatments in Distance Education , 2009 .

[12]  Khe Foon Hew,et al.  Student contribution in asynchronous online discussion: a review of the research and empirical exploration , 2010 .

[13]  Nicholaos Souleles,et al.  Elearning in art and design : perceptions and practices of lecturers in undergraduate studio-based disciplines and the rhetoric of innovative practices , 2011 .

[14]  F. Oort,et al.  The Influence of Affective Teacher–Student Relationships on Students’ School Engagement and Achievement , 2011 .

[15]  Rod P. Githens,et al.  OLDER ADULTS AND E-LEARNING Opportunities and Barriers , 2007 .

[16]  Ming-Chou Liu,et al.  Investigating Knowledge Integration in Web-based Thematic Learning Using Concept Mapping Assessment , 2010, J. Educ. Technol. Soc..

[17]  J. Biggs,et al.  Teaching For Quality Learning At University , 1999 .

[18]  Albert D. Ritzhaupt,et al.  A Job Announcement Analysis of Educational Technology Professional Positions , 2015 .

[19]  Gary Beauchamp,et al.  Interactivity in the classroom and its impact on learning , 2010, Comput. Educ..

[20]  Yong-lin Moon.  Education reform and competency-based education , 2007 .

[21]  Brent Muirhead.  Interactivity in a Graduate Distance Education School , 2000, J. Educ. Technol. Soc..

[22]  Lyle M. Spencer,et al.  Competence at Work: Models for Superior Performance , 1993 .

[23]  Hyo-Jeong So,et al.  Toward pervasive knowledge building discourse: analyzing online and offline discourses of primary science learning in Singapore , 2010 .

[24]  V. Dennen,et al.  Instructor–Learner Interaction in Online Courses: The relative perceived importance of particular instructor actions on performance and satisfaction , 2007 .

[25]  Margaret Mazzolini,et al.  When to jump in: The role of the instructor in online discussion forums , 2007, Comput. Educ..

[26]  P. Ström,et al.  Validation and learning in the Procedicus KSA virtual reality surgical simulator , 2003, Surgical Endoscopy And Other Interventional Techniques.

[27]  Sneha Sharma,et al.  IMPACT OF AGE AND INTERNET ACCESS AND USAGE ON STUDENT'S ATTITUDE TOWARDS E-LEARNING: A STUDY ON PANJAB UNIVERSITY , 2012 .

[28]  K. Phelan,et al.  An Exploratory Study of Knowledge, Skills, and Abilities (KSAs) Needed in Undergraduate Hospitality Curriculums in the Convention Industry , 2010 .

[29]  J. Armstrong,et al.  Natural Learning in Higher Education , 2010 .

[30]  Dowming Yeh,et al.  The Analysis of Learning Records and Learning Effect in Blended e-Learning , 2005, J. Inf. Sci. Eng..

[31]  Uzoamaka P. Anakwe,et al.  Knowledge‐related skills and effective career management , 2000 .

[32]  Ruirui Zhang,et al.  A framework of project-based integrated learning environment for animation design , 2010, 2010 International Conference on Artificial Intelligence and Education (ICAIE).

[33]  P. Bobko,et al.  A Meta-Analysis of Gender Group Differences for Measures of Job Performance in Field Studies , 2012 .

[34]  J. Allen,et al.  An Interaction-Based Approach to Enhancing Secondary School Instruction and Student Achievement , 2011, Science.

[35]  James W. Altschuld,et al.  Beyond initial certification: the assessment and maintenance of competency in professions , 2000 .

[36]  M. S. Balaji,et al.  Student Interactions in Online Discussion Forum: Empirical Research from "Media Richness Theory" Perspective. , 2010 .

[37]  Roger Prestwich,et al.  Knowledge, Skills and Abilities of International Business Majors , 2007 .

[38]  Hong Wei Jiang,et al.  A Framework of Animation System Embedded E-S Process , 2013 .

[39]  Erping Zhu,et al.  Interaction and cognitive engagement: An analysis of four asynchronous online discussions , 2006 .

[40]  Ruirui Zhang,et al.  A conceptual approach for project-based pedagogical processes embedded in an existing e-learning platform , 2011, 2011 International Conference on Uncertainty Reasoning and Knowledge Engineering.

[41]  Raghu Raman,et al.  Complementing Neurophysiology Education for Developing Countries via Cost-Effective Virtual Labs: Case Studies and Classroom Scenarios. , 2014, Journal of undergraduate neuroscience education : JUNE : a publication of FUN, Faculty for Undergraduate Neuroscience.

[42]  Cees de Jong,et al.  Aspects of Competence-Based Education as Footholds to Improve the Connectivity Between Learning in School and in the Workplace , 2010 .

[43]  Roger Haslam,et al.  Exploring the knowledge, skills, abilities and other factors of ergonomics advisors , 2011 .

[44]  Min Liu,et al.  The impact of animation interactivity on novices' learning of introductory statistics , 2011, Comput. Educ..

[45]  Richard J. Klimoski,et al.  Courage: Making Teamwork Work Well , 2014 .

[46]  Scott J. Savage,et al.  Instructor attire and student performance: Evidence from an undergraduate industrial organization experiment , 2014 .

[47]  Rogelio A. Lasso.  Is Our Students Learning?: Using Assessments to Measure and Improve Law School Learning , 2009 .

[48]  E. Eisner.  The Arts and the Creation of Mind , 2003, Language Arts.

[49]  Judith B. Pena-Shaff,et al.  Analyzing student interactions and meaning construction in computer bulletin board discussions , 2004, Comput. Educ..

[50]  H. Goldstein.  Multilevel Statistical Models , 2006 .

[51]  Chris Dede,et al.  The evolution of distance education: Emerging technologies and distributed learning , 1996 .

[52]  M. Välimäki,et al.  Impact of e-learning on nurses' and student nurses knowledge, skills, and satisfaction: a systematic review and meta-analysis. , 2014, International journal of nursing studies.

[53]  Hyo-Jeong So,et al.  Designing collaborative knowledge building environments accessible to all learners: Impacts and design challenges , 2010, Comput. Educ..

[54]  Paul Schrodt,et al.  The relationship between organizational identification and organizational culture: Employee perceptions of culture and identification in a retail sales organization , 2002 .

[55]  Thomas Wrba,et al.  Not The Ghost in The Machine: Transforming Patient Data into E-Learning Cases Within A Case-Based Blended Learning Framework For Medical Education☆ , 2015 .

[56]  Anymir Orellana,et al.  CLASS SIZE AND INTERACTION IN ONLINE COURSES , 2006 .

[57]  Eric Tsui,et al.  Knowledge management perspective on e-learning effectiveness , 2009, Knowl. Based Syst..

[58]  Regina Jucks,et al.  Learning through online peer discourse: Structural equation modeling points to the role of discourse activities in individual understanding , 2012, Comput. Educ..