Effects on learners' performance of using selected and open network resources in a problem-based learning activity

Owing to the popularity of computers and computer networks, fostering the web-based problem-solving ability of students has become an important educational objective in recent years. This study attempted to compare the effects of using selected and open network resources on students' intentions with regard to their information system usage by means of technology acceptance model (TAM) questionnaires and learning effectiveness by analysis of covariance of tests in web-based problem-solving activities. An experiment was conducted by situating students from a senior high school computer course in web-based learning environments with open or selected resources to find the answers to several questions about 'structured programming design.' The experimental results showed that in either the open-resource network or the selected-resource network, low-achievement students made remarkable progress. Moreover, the high-achievement students who learned in the selected-resource network had significantly better performance than those who learned in the open-resource network. In addition, the learning task completion ratio and the difficulties the students encountered were recorded and analyzed, and the perceptions of the students regarding their engagement in the learning activity are compared and discussed based on the TAM. Practitioner Notes What is already known about this topic Problem-based learning has been recognized as being an important instructional strategy., The provision of web-based problem-solving instructions has the potential to enhance and sustain the problem-solving skills of the learners., Searching for information to solve problems has been categorized as involving higher-order cognitive processes., Fostering students to develop problem-solving competences is helpful to them in efficiently learning the subject content., What this paper adds Investigating whether different information-searching environments (open and selected network resources) affect the students' web-based problem-solving performance., Investigating whether different information-searching environments affect the learning achievements of the students after participating in the web-based problem-solving activity., Investigating the students' degrees of acceptance of the information-searching environments and the correlations between the variables in the environments., Implications for practice and/or policy Both selected- and open-resource networks are helpful to low and midability students in improving their learning performance., Investing in the selected resources should improve significantly the high-achieving students' performance in comparison with using the open resources., Digital libraries can be put into use in conducting web-based problem-solving activities more widely and are worth developing., Governments or teaching institutes are encouraged to establish digital learning centers and develop digital libraries in which there are many well-prepared and correct instructional databases for learners to search or consult. [ABSTRACT FROM AUTHOR]

[1]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[2]  Lih-Shyang Chen,et al.  Applications of a Time Sequence Mechanism In the Simulation Cases of a web-based Medical Problem-Based Learning System , 2009, J. Educ. Technol. Soc..

[3]  Xun Ge,et al.  Prompting in Web-Based Environments: Supporting Self-Monitoring and Problem Solving Skills in College Students , 2008 .

[4]  Gwo-Jen Hwang,et al.  A novel approach for assisting teachers in analyzing student web-searching behaviors , 2008, Comput. Educ..

[5]  H. She,et al.  The effects of Web‐based/non‐Web‐based problem‐solving instruction and high/low achievement on students’ problem‐solving ability and biology achievement , 2010 .

[6]  Yixin Zhang Development and validation of an internet use attitude scale , 2007, Comput. Educ..

[7]  Andy Lane,et al.  Are open educational resources systematic or systemic change agents for teaching practice? , 2010, Br. J. Educ. Technol..

[8]  Gwo-Jen Hwang,et al.  Optimal self-explanation prompt design in dynamic multi-representational learning environments , 2010, Comput. Educ..

[9]  James D. Klein,et al.  The Impact of Scaffolding and Student Achievement Levels in a Problem-based Learning Environment , 2007 .

[10]  John W. Saye,et al.  Implementation and evaluation of a student-centered learning unit: A case study , 2000 .

[11]  Hatice Ferhan Odabasi,et al.  Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills , 2009, Comput. Educ..

[12]  David H. Jonassen,et al.  Learning to Solve Problems : A Handbook for Designing Problem-Solving Learning Environments , 2010 .

[13]  Wilfred W. F. Lau,et al.  Exploring the effects of gender and learning styles on computer programming performance: implications for programming pedagogy , 2009, Br. J. Educ. Technol..

[14]  Meltem Huri Baturay,et al.  The effects of problem-based learning on the classroom community perceptions and achievement of web-based education students , 2010, Comput. Educ..

[15]  Gwo-Jen Hwang,et al.  An auto-scoring mechanism for evaluating problem-solving ability in a web-based learning environment , 2009, Comput. Educ..

[16]  Timothy Teo,et al.  Examining the influence of subjective norm and facilitating conditions on the intention to use technology among pre-service teachers: a structural equation modeling of an extended technology acceptance model , 2010 .

[17]  S. Breckler Applications of covariance structure modeling in psychology: cause for concern? , 1990, Psychological bulletin.

[18]  Ginger S. Watson,et al.  The impact of content area focus on the effectiveness of a web-based simulation , 2010, Br. J. Educ. Technol..

[19]  Gwo-Jen Hwang,et al.  The correlates of Taiwan teachers' epistemological beliefs concerning Internet environments, online search strategies, and search outcomes , 2011, Internet High. Educ..

[20]  Shu-Sheng Liaw,et al.  Information retrieval from the World Wide Web: a user-focused approach based on individual experience with search engines , 2006, Comput. Hum. Behav..

[21]  Timothy Teo,et al.  Using structural equation modelling (SEM) in educational technology research: Issues and guidelines , 2010, Br. J. Educ. Technol..

[22]  Peggy A. Ertmer,et al.  Jumping the PBL Implementation Hurdle: Supporting the Efforts of K-12 Teachers. , 2006 .

[23]  Gwo-Dong Chen,et al.  Surveying instructor and learner attitudes toward e-learning , 2007, Comput. Educ..

[24]  Ying-Tien Wu,et al.  Developing an Information Commitment Survey for Assessing Students' Web Information Searching Strategies and Evaluative Standards for Web Materials , 2007, J. Educ. Technol. Soc..

[25]  C. Hmelo‐Silver Problem-Based Learning: What and How Do Students Learn? , 2004 .

[26]  Roger C. Schank,et al.  The design of Goal-Based Scenarios , 1994 .

[27]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[28]  B. Bloom,et al.  Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , 1966 .

[29]  Kuo-Hung Tseng,et al.  Interactive processes and learning attitudes in a web-based problem-based learning (PBL) platform , 2008, Comput. Hum. Behav..

[30]  Lih-Juan ChanLin,et al.  Assessment of PBL Design Approach in a Dietetic Web-Based Instruction , 2004 .

[31]  Min Liu,et al.  Alien Rescue: A Problem-Based Hypermedia Learning Environment for Middle School Science , 2002 .

[32]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[33]  David H. Jonassen,et al.  Instructional design models for well-structured and III-structured problem-solving learning outcomes , 1997 .

[34]  Xuyang Qian A Framework for Designing Problem-Based Learning Environments , 2009, 2009 First International Workshop on Education Technology and Computer Science.

[35]  Chin-Chung Tsai,et al.  Information searching strategies in web-based science learning: the role of internet self-efficacy , 2003 .

[36]  Shu-Sheng Liaw,et al.  An investigation of user attitudes toward search engines as an information retrieval tool , 2003, Comput. Hum. Behav..

[37]  Richard E. Clark,et al.  Facilitating Domain-General Problem Solving: Computers, Cognitive Processes and Instruction , 1992 .

[38]  Kumar Laxman,et al.  A conceptual framework mapping the application of information search strategies to well and ill-structured problem solving , 2010, Comput. Educ..

[39]  Bibi Eshrat Zamani,et al.  Acceptance of the Internet by Iranian business management students , 2010, Br. J. Educ. Technol..

[40]  Eliane Segers,et al.  WebQuests in special primary education: Learning in a web-based environment , 2011, Br. J. Educ. Technol..

[41]  Gwo-Jen Hwang,et al.  A knowledge acquisition approach to developing Mindtools for organizing and sharing differentiating knowledge in a ubiquitous learning environment , 2011, Comput. Educ..

[42]  Irfan Naufal Umar,et al.  The Effects of a Web-based Guided Inquiry Approach on Students' Achievement , 2007, J. Comput..

[43]  Tiffany A. Koszalka,et al.  Patterns of Instructional-design Factors Prompting Reflective Thinking in Middle-school and College Level Problem-based Learning Environments , 2006 .

[44]  Ritu Agarwal,et al.  Are Individual Differences Germane to the Acceptance of New Information Technologies , 1999 .

[45]  Dong Won Kim,et al.  A Web-Based Learning Support System for Inquiry-Based Learning , 2010 .

[46]  Judith Molka-Danielsen,et al.  Empathy in virtual learning environments , 2009, Int. J. Netw. Virtual Organisations.

[47]  Fadi P. Deek,et al.  A critical analysis and evaluation of Web-based environments for program development , 2000, Internet and Higher Education.

[48]  Yun Yang,et al.  Emerging Web Technologies in Higher Education: A Case of Incorporating Blogs, Podcasts and Social Bookmarks in a Web Programming Course based on Students' Learning Styles and Technology Preferences , 2009, J. Educ. Technol. Soc..

[49]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[50]  Chih-Ming Chen,et al.  Problem-based learning supported by digital archives: Case study of Taiwan Libraries' History Digital Library , 2010, Electron. Libr..

[51]  Gwo-Jen Hwang,et al.  A web-based programming learning environment to support cognitive development , 2008, Interact. Comput..

[52]  Thomas M. Duffy,et al.  Problem Based Learning: An instructional model and its constructivist framework , 1995 .

[53]  Hans van der Meij,et al.  Supporting reflective web searching in elementary schools , 2008, Comput. Hum. Behav..

[54]  L. Harlow,et al.  Effects of estimation methods, number of indicators per factor, and improper solutions on structural equation modeling fit indices , 1995 .

[55]  Susanne P. Lajoie,et al.  Computer Environments as Cognitive Tools for Enhancing Learning , 2013 .

[56]  Heather Leary,et al.  A Problem Based Learning Meta Analysis: Differences across Problem Types, Implementation Types, Disciplines, and Assessment Levels. , 2009 .

[57]  Chia-Ching Lin,et al.  Meta-Analyzer: A Web-based Environment for Analyzing Student Information Searching Behaviors , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[58]  T. Teo,et al.  Understanding Technology Acceptance in Pre-Service Teachers: A Structural-Equation Modeling Approach , 2009 .

[59]  Su-Chao Chang,et al.  An empirical investigation of students' behavioural intentions to use the online learning course websites , 2007, Br. J. Educ. Technol..

[60]  James D. Klein,et al.  Instructional Strategies Utilized During the Implementation of a Hypermedia, Problem-Based Learning Environment: A Case Study , 2004 .

[61]  Pei-Di Shen,et al.  Applying Web-Enabled Problem-Based Learning and Self-Regulated Learning to Enhance Computing Skills of Taiwan's Vocational Students: A Quasi-Experimental Study of a Short-Term Module. , 2007 .

[62]  Xun Ge,et al.  A Cognitive Support System to Scaffold Students’ Problem-based Learning in a Web-based Learning Environment , 2010 .

[63]  Gwo-Jen Hwang,et al.  An Information-Summarising Instruction Strategy for Improving the Web-Based Problem Solving Abilities of Students. , 2011 .