Content Management Systems: Enriched learning opportunities for all?

This article examines the popular claim of Content Management Systems (CMSs) that providing a rich toolset and leaving the use under learner control is beneficial to learning. By means of a literature review, the current contribution examines whether all students are capable of using CMS tools so that their learning is enhanced. In contrast to what is assumed, the study conceptualizes tool use as a complex self-regulation strategy that cannot be taken for granted. Specifically, the article reviews empirical studies in relation to three topics: (a) personal agency in tool use, (b) performance effects of tool use and (c) influencing tool use variables. Findings reveal that not every student profited from the CMS learning opportunities; in multiple studies students differed in their tool use, and these differences had significant performance effects. Hence, these findings suggest that the pedagogical claim CMSs make is problematic. Besides this accumulated corpus of knowledge, the review revealed serious limitations in the retrieved studies which could hamper our findings. As a consequence, the review establishes a need for further research into students' CMS tool use from an instructional design perspective. In addition to the theoretical framework, several directions for future research are given.

[1]  A. Elliot.  Approach and avoidance motivation and achievement goals , 1999 .

[2]  P. Ifinedo.  Acceptance and Continuance Intention of Web‐based Learning Technologies (WLT) Use among University Students in a Baltic Country , 2006, Electron. J. Inf. Syst. Dev. Ctries..

[3]  Genevieve Marie Johnson,et al.  Student Alienation, Academic Achievement, and WebCT Use , 2005, J. Educ. Technol. Soc..

[4]  Min Liu,et al.  Understanding the Connection between Cognitive Tool Use and Cognitive Processes as Used by Sixth Graders in a Problem-Based Hypermedia Learning Environment , 2004 .

[5]  Eric W. T. Ngai,et al.  Empirical examination of the adoption of WebCT using TAM , 2007, Comput. Educ..

[6]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[7]  E. A. Attree,et al.  WebCT: A Useful Support Tool for Psychology Undergraduates — A Q Methodological Study , 2006 .

[8]  Nor Azan Mat Zin,et al.  Journal of Theoretical and Applied Information Technology the Success of Learning Management System among Distance Learners in Malaysian Universities Student, School of Information Technology , 2022 .

[9]  Jane E. Klobas,et al.  A task-technology fit view of learning management system impact , 2009, Comput. Educ..

[10]  J. Nicholls.  Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance. , 1984 .

[11]  Ruth Butler,et al.  Effects of Task and Ego Achievement Goals on Help-Seeking Behaviors and Attitudes. , 1995 .

[12]  J. Flavell.  Developmental studies of mediated memory. , 1970, Advances in child development and behavior.

[13]  T. Andre.  Does Answering Higher-Level Questions While Reading Facilitate Productive Learning? , 1979 .

[14]  Branka Spehar,et al.  Resource use and academic performance among first year psychology students , 2007 .

[15]  Barbara A. Greene,et al.  Influences on achievement : Goals, perceived ability, and cognitive engagement , 1996 .

[16]  Philip H. Winne,et al.  Why process-product research cannot explain process-product findings and a proposed remedy: The cognitive mediational paradigm , 1987 .

[17]  Nada Dabbagh,et al.  Using Web-based Pedagogical Tools as Scaffolds for Self-regulated Learning , 2005 .

[18]  Geraldine Clarebout,et al.  Benefits of inserting support devices in electronic learning environments , 2009, Comput. Hum. Behav..

[19]  Judith Gal-Ezer,et al.  Integrating internet tools into traditional CS distance education: students' attitudes , 2002, Comput. Educ..

[20]  N. Pliskin,et al.  Student LMS use and satisfaction in academic institutions: The organizational perspective , 2010, Internet High. Educ..

[21]  C. Philip Beaman,et al.  Access to Online Resources: A Case Study , 2006 .

[22]  Min Liu,et al.  An analysis of cognitive tool use patterns in a hypermedia learning environment , 2005 .

[23]  Carlos Delgado Kloos,et al.  Student Behavior and Interaction Patterns With an LMS as Motivation Predictors in E-Learning Settings , 2010, IEEE Transactions on Education.

[24]  Philip H. Winne,et al.  Learning from Learning Kits: gStudy Traces of Students’ Self-Regulated Engagements with Computerized Content , 2006 .

[25]  Mun Y. Yi,et al.  Predicting the use of web-based information systems: self-efficacy, enjoyment, learning goal orientation, and the technology acceptance model , 2003, Int. J. Hum. Comput. Stud..

[26]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[27]  Geraldine Clarebout,et al.  The complexity of tool use in computer-based learning environments , 2009 .

[28]  A. Bandura.  Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[29]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[30]  Martin Valcke,et al.  The Actual Use of Embedded Support Devices in Self-Study Materials by Students in a Distance Education Setting , 1992 .

[31]  J. Vermunt.  Relations between student learning patterns and personal and contextual factors and academic performance , 2005 .

[32]  Wanda M. Costen.  The value of staying connected with technology: An analysis exploring the impact of using a course management system on student learning , 2009 .

[33]  G. Salomon.  Television is "easy" and print is "tough": The differential investment of mental effort in learning as a function of perceptions and attributions. , 1984 .

[34]  Min Liu,et al.  Cognitive tools, individual differences, and group processing as mediating factors in a hypermedia environment , 2006, Comput. Hum. Behav..

[35]  Martin Valcke,et al.  Interactive learning environments to support independent learning: The impact of discernability of embedded support devices , 1997, Comput. Educ..

[36]  D. Wood,et al.  Help seeking, learning and contingent tutoring , 1999, Comput. Educ..

[37]  Lucas Horton,et al.  Students' Problem Solving as Mediated by Their Cognitive Tool Use: A Study of Tool Use Patterns , 2007 .

[38]  Philip H. Winne,et al.  Students’ calibration of knowledge and learning processes: Implications for designing powerful software learning environments , 2004 .

[39]  E. Stahl,et al.  Help-seeking in Interactive Learning Environments: Effectiveness of Help and Learner-related Factors in a Dyadic Setting , 2004, ICLS.

[40]  Debbie L. Hahs-Vaughn,et al.  Combined longitudinal effects of attitude and subjective norms on student outcomes in a web-enhanced course: A structural equation modelling approach , 2007, Br. J. Educ. Technol..

[41]  Andrew T. Lumpe,et al.  The Information Seeking Strategies of High School Science Students , 2002 .

[42]  A. Elliot,et al.  A HIERARCHICAL MODEL OF APPROACH AND AVOIDANCE ACHIEVEMENT MOTIVATION , 1997 .

[43]  Jan Elen,et al.  The use of support devices in electronic learning environments , 2009, Comput. Hum. Behav..

[44]  K. Kemper,et al.  Curriculum Resource Use and Relationships With Educational Outcomes in an Online Curriculum , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[45]  D. Perkins.  The Fingertip Effect: How Information-Processing Technology Shapes Thinking , 1985 .

[46]  R. A. Ellis,et al.  Learning through inquiry: student difficulties with online course-based Material , 2005, J. Comput. Assist. Learn..

[47]  Walter Doyle,et al.  4: Paradigms for Research on Teacher Effectiveness , 1977 .

[48]  Philip H. Winne,et al.  Minimizing the black box problem to enhance the validity of theories about instructional effects , 1982 .

[49]  Kristy J. Lauver,et al.  Do psychosocial and study skill factors predict college outcomes? A meta-analysis. , 2004, Psychological bulletin.

[50]  N. Entwistle,et al.  Understanding Student Learning , 1983 .

[51]  Jennifer A. Lyke,et al.  Cognition in Context: Students’ Perceptions of Classroom Goal Structures and Reported Cognitive Strategy Use in the College Classroom , 2006 .

[52]  Raymond P. Perry,et al.  Academic help-seeking in the university setting: The effects of motivational set, attributional style, and help source characteristics , 1992 .

[53]  S. Thompson.  Social Learning Theory , 2008 .

[54]  Gudela Grote,et al.  Distributed collaboration activities in a blended learning scenario and the effects on learning performance , 2007, J. Comput. Assist. Learn..

[55]  Elizabeth A. Linnenbrink.  The Dilemma of Performance-Approach Goals: The Use of Multiple Goal Contexts to Promote Students' Motivation and Learning. , 2005 .

[56]  Hayne W. Reese,et al.  Verbal mediation as a function of age level. , 1962 .

[57]  Genevieve Marie Johnson,et al.  Attitude Toward Instructional Technology Following Required Versus Optional WebCT Usage , 2005 .

[58]  Alvin Y. Wang,et al.  Characteristics of students who enroll and succeed in psychology Web-based classes. , 2000 .

[59]  Jane E. Klobas,et al.  The role of involvement in learning management system success , 2010, J. Comput. High. Educ..

[60]  Peg A Ertmer,et al.  Open Learning Environments, Foundations, Methods, and Models , 2012 .

[61]  N. Kuncel,et al.  Study Habits, Skills, and Attitudes: The Third Pillar Supporting Collegiate Academic Performance , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[62]  Lei Qu,et al.  Mathematics motivation and achievement as predictors of high school students' guessing and help-seeking with instructional software , 2008, J. Comput. Assist. Learn..

[63]  R. Azevedo.  Using Hypermedia as a Metacognitive Tool for Enhancing Student Learning? The Role of Self-Regulated Learning , 2005 .

[64]  Geraldine Clarebout,et al.  The relation between self-regulation and the embedding of support in learning environments , 2010 .

[65]  Cynthia L. Friend,et al.  Learner control in computer-based instruction: a current literature review , 1990 .

[66]  D. Wood.  Scaffolding, contingent tutoring and computer-supported learning , 2001 .

[67]  Gerald Halpin,et al.  Relative Effectiveness of the California Achievement Tests in Comparison With the Act Assessment, College Board Scholastic Aptitude Test, and High School Grade Point Average in Predicting College Grade Point Average , 1981 .

[68]  Sherria L. Hoskins,et al.  Motivation and ability: which students use online learning and what influence does it have on their achievement? , 2005, Br. J. Educ. Technol..

[69]  Steve Love,et al.  Evaluating WebCT Use in Relation to Students' Attitude and Performance , 2008, Int. J. Inf. Commun. Technol. Educ..

[70]  R. Arteaga Sánchez,et al.  Motivational factors that influence the acceptance of Moodle using TAM , 2010, Comput. Hum. Behav..

[71]  J. Liker,et al.  User acceptance of expert systems: a test of the theory of reasoned action , 1997 .

[72]  Stanley H. Cohen,et al.  Evaluating Student Use of Web-Based Course Material , 2005 .

[73]  Geraldine Clarebout,et al.  Tool use in computer-based learning environments: towards a research framework , 2006, Comput. Hum. Behav..

[74]  Carol S. Dweck,et al.  Motivational processes affecting learning. , 1986 .

[75]  G. Salomon.  Studying the flute and the orchestra: controlled vs. classroom research on computers , 1990 .

[76]  H. Coates,et al.  A Critical Examination Of The Effects Of Learning Management Systems On University Teaching And Learning , 2005 .

[77]  Pam Marek,et al.  Pedagogical Aids in Textbooks: Do College Students' Perceptions Justify Their Prevalence? , 1999 .

[78]  Andrew Large,et al.  Hypertext Instructional Programs and Learner Control: A Research Review. , 1996 .

[79]  Stuart A. Karabenick,et al.  Perceived Achievement Goal Structure and College Student Help Seeking. , 2004 .

[80]  R. Butler.  Determinants of help seeking : Relations between perceived reasons for classroom help-avoidance and help-seeking behaviors in an experimental context , 1998 .

[81]  Mark Grabe,et al.  Optional student use of online lecture resources: resource preferences, performance and lecture attendance , 2007, J. Comput. Assist. Learn..

[82]  Mei-jung Wang,et al.  Online collaboration and offline interaction between students using asynchronous tools in blended learning , 2010 .

[83]  Teresa Martín-Blas,et al.  The role of new technologies in the learning process: Moodle as a teaching tool in Physics , 2009, Comput. Educ..

[84]  Craig Ross,et al.  The timing of online lecture slide availability and its effect on attendance, participation, and exam performance , 2009, Comput. Educ..

[85]  Philip H. Winne,et al.  How Software Technologies Can Improve Research on Learning and Bolster School Reform , 2006 .

[86]  Jasper Knight,et al.  Distinguishing the learning approaches adopted by undergraduates in their use of online resources , 2010 .

[87]  Richard S. Newman,et al.  Students' help seeking during problem solving: Influences of personal and contextual achievement goals. , 1998 .

[88]  Geraldine Clarebout,et al.  The relationships between learner variables, tool-usage behaviour and performance , 2009, Comput. Hum. Behav..

[89]  Jan Elen,et al.  The impact of instructional conceptions on the use of adjunct aids , 2006 .

[90]  Steven R. Malikowski,et al.  A Model for Research into Course Management Systems: Bridging Technology and Learning Theory , 2007 .

[91]  Vincent Aleven,et al.  Limitations of Student Control: Do Students Know When They Need Help? , 2000, Intelligent Tutoring Systems.

[92]  Daniel DeNeui,et al.  Asynchronous Learning Networks and Student Outcomes: The Utility of Online Learning Components in Hybrid Courses , 2006 .

[93]  Mark Grabe,et al.  Evaluating the advantages and disadvantages of providing lecture notes: The role of internet technology as a delivery system and research tool , 2005, Internet High. Educ..

[94]  Fred D. Davis.  User Acceptance of Information Technology: System Characteristics, User Perceptions and Behavioral Impacts , 1993, Int. J. Man Mach. Stud..