The multiple effects of combined tools in computer-based learning environments

Learners with high performance avoidance and perceived usability levels decreased the use of the tools.Learners with high critical thinking increased tool use.Only one of the two employed tools influenced performance positively.Time spent on tool seems to be positively related to performance.The (non-/)embeddedness of the tools and the tool advice influenced performance positively. Research has repeatedly established that the theoretical benefits of support devices, also addressed as tools, in computer-based learning environments (CBLEs) do not match their actual impact on performance. This study investigated the effectiveness and the use of tools in a CBLE. The impact of combined tools (concept maps and adjunct questions), tool-related characteristics (tool delivery mode: non-/embedded tool), tool advice (non-/explained tool functionality) and learner-related characteristics (prior knowledge, self-efficacy, goal orientation, perceptions and self-regulation) on the quantity and quality of tool use was analyzed. The effects of tool use on performance were also studied. One hundred and eighty-two participants were randomly assigned to one out of five conditions (embedded with and without explanation of tool functionality; non-embedded with and without explanation of tool functionality and a control condition). The results revealed that the tools were functional: Learners in the experimental groups did better in the performance test than the learners in the control group. Specifically, learners in the non-embedded conditions and with the explanation of the tool performed better than the control condition. Furthermore, learners in the embedded conditions spent significantly more time on both tools. The time spent on the tools decreased in learners with high performance avoidance levels (goal orientation) and tool usability perceptions, but increased in learners with high critical thinking (self-regulation skill). Consecutively, the time spent on the tools influenced performance positively. These findings are discussed in terms of their implications for further research on tool use.

[1]  P. Petraitis,et al.  Inferring multiple causality : the limitations of path analysis , 1996 .

[2]  J. S. Tanaka "How Big Is Big Enough?": Sample Size and Goodness of Fit in Structural Equation Models with Latent Variables. , 1987 .

[3]  T. C. Edwin Cheng,et al.  The role of perceived user-interface design in continued usage intention of self-paced e-learning tools , 2009, Comput. Educ..

[4]  G. Clarebout,et al.  Tool-use in a content management system: a matter of timing? , 2014, Learning Environments Research.

[5]  D. Perkins The Fingertip Effect: How Information-Processing Technology Shapes Thinking , 1985 .

[6]  Patricia A. Alexander,et al.  Mapping prior knowledge: A framework for discussion among researchers , 1995 .

[7]  M. David Merrill Learner control in computer based learning , 1980 .

[8]  Jan Elen,et al.  Instructional effectiveness of higher-order questions: The devil is in the detail of students’ use of questions , 2011 .

[9]  Min Liu,et al.  Cognitive tools, individual differences, and group processing as mediating factors in a hypermedia environment , 2006, Comput. Hum. Behav..

[10]  J. Greene,et al.  Adolescents' Use of Self-Regulatory Processes and Their Relation to Qualitative Mental Model Shifts While Using Hypermedia , 2006, ICLS.

[11]  Lisa D. Bendixen,et al.  Educational Research in the Internet Age: Examining the Role of Individual Characteristics , 2001 .

[12]  Michael J. Hannafin,et al.  Cognitive Tools for Open-Ended Learning Environments: Theoretical and Implementation Perspectives. , 1998 .

[13]  J. Carroll A Model of School Learning , 1963, Teachers College Record: The Voice of Scholarship in Education.

[14]  R. Atkinson Optimizing learning from examples using animated pedagogical agents. , 2002 .

[15]  Susan M. Land,et al.  Open learning environments: Foundations, methods, and models , 2013 .

[16]  Dirk Raes,et al.  Waarom water broodnodig is , 2009 .

[17]  V. Aleven,et al.  Help Seeking and Help Design in Interactive Learning Environments , 2003 .

[18]  R. Newman Adaptive help seeking: A strategy of self-regulated learning. , 1994 .

[19]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[20]  Janet Mannheimer Zydney,et al.  Cognitive Tools for Scaffolding Students Defining an Ill-Structured Problem , 2008 .

[21]  Keenan A. Pituch,et al.  The influence of system characteristics on e-learning use , 2006, Comput. Educ..

[22]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[23]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[24]  Roger Azevedo,et al.  Teaching and Learning in Technology-Rich Environments , 2006 .

[25]  Miltiadis D. Lytras,et al.  Software Technologies in Knowledge Society , 2011, J. Univers. Comput. Sci..

[26]  Juanita M. Cole,et al.  The Effects of Web-Based Reading Curriculum on Children's Reading Performance and Motivation , 2006 .

[27]  Jan Elen,et al.  Handling Complexity in Learning Environments: Theory and Research. Advances in Learning and Instruction. , 2006 .

[28]  Briony D. Pulford,et al.  The influence of advice in a virtual learning environment , 2011, Br. J. Educ. Technol..

[29]  A. Dillon,et al.  Hypermedia as an Educational Technology: A Review of the Quantitative Research Literature on Learner Comprehension, Control, and Style , 1998 .

[30]  P. Pintrich A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ). , 1991 .

[31]  Laura K. Brunner,et al.  “How Big is Big Enough?” , 2010 .

[32]  Wolfgang Schnotz,et al.  Semantic scaffolds in hypermedia learning environments , 2009, Comput. Hum. Behav..

[33]  John B. Carroll,et al.  The Carroll Model , 1989 .

[34]  Christiaan Hamaker The Effects of Adjunct Questions on Prose Learning , 1986 .

[35]  Rolland Viau,et al.  Learning tools with hypertext: an experiment , 1993 .

[36]  James Daniel Lehman,et al.  Instructional Cuing in Hypermedia: A Study with Active and Passive Learners. , 1993 .

[37]  Philip H. Winne,et al.  Relations Among the Structure of Learning Tasks, Achievement, and Changes in Self-Efficacy in Secondary Students. , 2005 .

[38]  A. Elliot,et al.  A 2 X 2 achievement goal framework. , 2001, Journal of personality and social psychology.

[39]  Geraldine Clarebout,et al.  Perceptions for Tool Use: In Search of a Tool Use Model , 2012 .

[40]  Geraldine Clarebout,et al.  Tool use in computer-based learning environments: towards a research framework , 2006, Comput. Hum. Behav..

[41]  Nathalie Huet,et al.  The influence of achievement goals and perceptions of online help on its actual use in an interactive learning environment , 2011, Comput. Hum. Behav..

[42]  Jan Elen,et al.  The Instructional Functionality of Multiple Adjunct Aids. , 2006 .

[43]  A. Elliot,et al.  A HIERARCHICAL MODEL OF APPROACH AND AVOIDANCE ACHIEVEMENT MOTIVATION , 1997 .

[44]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[45]  Geraldine Clarebout,et al.  The relation between self-regulation and the embedding of support in learning environments , 2010 .

[46]  Geraldine Clarebout,et al.  Tool Use of Experienced Learners in Computer-Based Learning Environments: Can Tools Be Beneficial?. , 2014 .

[47]  Nancy C. Goodwin,et al.  Functionality and usability , 1987, CACM.

[48]  F. Fischer,et al.  The Use of Additional Information in Problem-Oriented Learning Environments , 2000 .

[49]  Alberto J. Cañas,et al.  A TEORIA SUBJACENTE AOS MAPAS CONCEITUAIS E COMO ELABORÁ-LOS E USÁ-LOS * THE THEORY UNDERLYING CONCEPT MAPS AND HOW TO CONSTRUCT AND USE THEM , 2010 .

[50]  Geraldine Clarebout,et al.  Content Management Systems: Enriched learning opportunities for all? , 2012, Comput. Hum. Behav..

[51]  Feng Wang,et al.  Cognitive tools and student‐centred learning: rethinking tools, functions and applications , 2005 .

[52]  Kent J. Crippen,et al.  The Role of Goal Orientation and Self-Efficacy in Learning from Web-Based Worked Examples , 2009 .

[53]  Charles M. Reigeluth,et al.  Instructional-Design Theories and Models Volume III , 2009 .

[54]  Jan Elen,et al.  Tool Use and Performance: Relationships between Tool- and Learner-Related Characteristics in a Computer-Based Learning Environment. , 2013 .

[55]  Susan M. Land,et al.  A Qualitative Analysis of Scaffolding Use in a Resource-Based Learning Environment Involving the World Wide Web , 2000 .

[56]  G. Clarebout,et al.  Instructional conceptions: Analysis from an instructional design perspective , 2004 .

[57]  P. Winne Steps toward Promoting Cognitive Achievements , 1985, The Elementary School Journal.

[58]  Geraldine Clarebout,et al.  The use of instructional interventions: lean learning environments as a solution for a design problem , 2006 .

[59]  F. Hesse,et al.  When are powerful learning environments effective? The role of learner activities and of students’ conceptions of educational technology , 2004 .

[60]  María Teresa García Álvarez,et al.  ICTS and learning: a challenge in the engineering education , 2014 .

[61]  M. Araceli Ruiz-Primo,et al.  Examining Concept Maps as an Assessment Tool , 2004 .

[62]  Karoline Afamasaga-Fuata’i,et al.  Concept Maps as Innovative Learning and Assessment Tools in Primary Schools , 2009 .

[63]  O. Behling,et al.  Translating Questionnaires and Other Research Instruments: Problems and Solutions , 2000 .

[64]  M. Veenman Alternative assessment of strategy use with self-report instruments: a discussion , 2011 .