The effects of an online student-constructed test strategy on knowledge construction

The differential effects of online student-constructed tests (SCT) and student-generated questions (SGQ) strategies on knowledge construction in term of the breadth, depth, interconnectivity and elaboration of knowledge were examined via a quasi-experimental research design. Two classes of undergraduates (N?=?65) participated and were randomly assigned to two different treatment groups. An online system supporting the associated learning activities for the respective groups was developed. The results from the ANCOVA showed that students who engaged in SCT activities generated questions that covered significantly more concepts, involved significantly more levels of subordinate concepts, and built significantly more links between clusters of study topics, as compared to those in the SGQ group. Moreover, significantly more students in the SCT group engaged in item revision behavior than those in the SGQ group, and a majority of students in the SCT group exhibited item sequencing behavior, both of which are deemed indicative of knowledge elaboration. Suggestions and implications for instructional implementation, online system development and future studies are offered. Online Student-Constructed Test (SCT) is facilitative of knowledge construction.SCT enhanced knowledge breadth and depth better than student-generated questions.SCT is effective in promoting knowledge integration and elaboration.Knowledge integration is manifested in building more cross-links between concepts.Knowledge elaboration is demonstrated by item revision and sequencing behavior.

[1]  Nerida F. Ellerton,et al.  Engaging pre-service middle-school teacher-education students in mathematical problem posing: development of an active learning framework , 2013 .

[2]  Daniel C. West,et al.  Critical thinking in graduate medical education: A role for concept mapping assessment? , 2000, JAMA.

[3]  Fu-Yun Yu.  Learner-centered pedagogy + adaptable and scaffolded learning space design—online student question-generation. , 2012 .

[4]  Fu-Yun Yu,et al.  Scaffolding student-generated questions: Design and development of a customizable online learning system , 2009, Comput. Hum. Behav..

[5]  Charles M. Reigeluth,et al.  The elaboration theory: Guidance for scope and sequence decisions. , 1999 .

[6]  Y. Dori,et al.  Question-posing capability as an alternative evaluation method: Analysis of an environmental case study , 1999 .

[7]  R. Lee,et al.  Critical Inquiry Across the Disciplines: Strategies for Student-Generated Problem Posing , 2010 .

[8]  Kazuaki Kojima,et al.  A System that Facilitates Diverse Thinking in Problem Posing , 2008, Int. J. Artif. Intell. Educ..

[9]  Fu-Yun Yu,et al.  The design, development and preliminary evaluation of an online student-generated tests learning system , 2013, ICCE 2013.

[10]  Timothy L. Seifert,et al.  Enhancing memory for main ideas using elaborative interrogation , 1994 .

[11]  M. McDaniel,et al.  Generation and precision of elaboration: Effects on intentional and incidental learning. , 1987 .

[12]  Fu-Yun Yu.  Preliminary assessment of online student-generated tests for learning , 2013, ICCE 2013.

[13]  D. Krathwohl.  A Taxonomy for Learning, Teaching and Assessing: , 2008 .

[14]  Edward A. Silver,et al.  An Analysis of Arithmetic Problem Posing by Middle School Students. , 1996 .

[15]  Ruth H. Maki,et al.  Test predictions over text material. , 1998 .

[16]  Lyn D. English,et al.  Promoting a Problem-Posing Classroom. , 1997 .

[17]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[18]  Joseph Krajcik,et al.  The design of guided learner-adaptable scaffolding in interactive learning environments , 1996, CHI.

[19]  Sun-Young Oh.  Two Types of Input Modification and EFL Reading Comprehension: Simplification Versus Elaboration , 2001 .

[20]  A. W. Evans,et al.  TPL-KATS - concept map: a computerized knowledge assessment tool , 2003, Comput. Hum. Behav..

[21]  Merrilyn Goos,et al.  Teaching Mathematics in New Times, Proceedings of the 21st Annual Conference of the Mathematics Education Research Group of Australasia (MERGA) , 1998 .

[22]  Nihat Boz,et al.  The Effect of Problem Posing Oriented Analyses-II Course on the Attitudes toward Mathematics and Mathematics Self-Efficacy of Elementary Prospective Mathematics Teachers. , 2010 .

[23]  C. Reigeluth,et al.  Instructional-Design Theories and Models , 1999 .

[24]  C. Reigeluth.  Elaborating the elaboration theory , 1992 .

[25]  Chiung-Hui Chiu,et al.  Integrating reviewing strategies into shared electronic note-taking: Questioning, summarizing and note reading , 2013, Comput. Educ..

[26]  Stephen I. Brown,et al.  The Art of Problem Posing. 3rd Edition. , 2005 .

[27]  James Belanich,et al.  A Question-Collaboration Approach to Web-Based Learning , 2004 .

[28]  H. Suen,et al.  Concept Map Assessment of Classroom Learning: Reliability, Validity, and Logistical Practicality , 1999 .

[29]  Minsoo Kang,et al.  Validity and Responsiveness of Concept Map Assessment Scores in Physical Education. , 2015 .

[30]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[31]  Quasi-Experimental Design , 2010 .

[32]  Suzanne Q. Hoffman,et al.  Elaboration Theory and Hypermedia: Is There a Link?. , 1997 .

[33]  Ton de Jong,et al.  Student‐generated assignments about electrical circuits in a computer simulation , 2004 .

[34]  Susan M. Land,et al.  A conceptual framework for scaffolding III-structured problem-solving processes using question prompts and peer interactions , 2004 .

[35]  Stephen I. Brown,et al.  The Art of Problem Posing , 1983 .

[36]  J. Berry,et al.  Improving Learning through Interventions of Student-Generated Questions and Concept Maps , 2008 .

[37]  Fu-Yun Yu,et al.  Effects of student-generated questions as the source of online drill-and-practice activities on learning , 2014, Br. J. Educ. Technol..

[38]  Susan M. Land,et al.  Open learning environments: Foundations, methods, and models , 2013 .

[39]  Fu-Yun Yu,et al.  Effects of different types of online student question-generation on learning , 2011, ICCE 2011.

[40]  E. Ghatala,et al.  Sometimes Adults Miss the Main Ideas and Do Not Realize It: Confidence in Responses to Short-Answer and Multiple-Choice Comprehension Questions. , 1990 .

[41]  Fu-Yun Yu,et al.  Promoting Metacognitive Strategy Development through Online Question-Generation Instructional Approach , 2005, ICCE.

[42]  Fu-Yun Yu,et al.  Predictive Effects of Online Peer Feedback Types on Performance Quality , 2013, J. Educ. Technol. Soc..

[43]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[44]  F. Yu,et al.  Are There Any Joint Effects of Online Student Question Generation and Cooperative Learning? , 2014 .

[45]  Christine Chin,et al.  Student-generated questions: A meaningful aspect of learning in science , 2002 .

[46]  William R. Shadish,et al.  Quasi-experimental Designs , 2005 .

[47]  Peg A Ertmer,et al.  Open Learning Environments, Foundations, Methods, and Models , 2012 .

[48]  Charles S. Reichardt,et al.  Quasi-experimental design. , 2009 .

[49]  Bruce W. McMillan,et al.  Social and educational reform in New Zealand: The promise and threat of information technology , 1995 .

[50]  F. Yu,et al.  Student question-generation: The learning processes involved and their relationships with students' perceived value , 2012 .

[51]  Diana C. Rice,et al.  Using Concept Maps to Assess Student Learning in the Science Classroom: Must Different Methods Compete?. , 1998 .

[52]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[53]  B. Rosenshine,et al.  Teaching Students to Generate Questions: A Review of the Intervention Studies , 1996 .

[54]  M. C. Wittrock,et al.  The Cognitive Movement in Instruction , 1979 .

[55]  Paul H. King,et al.  Concept Mapping as a Form of Student Assessment and Instruction , 2002 .

[56]  Amir Rezaei,et al.  Use of Syntactic Elaboration Techniques to Enhance Comprehensibility of EST Texts , 2011 .

[57]  Yu-Hsin Liu,et al.  Potential Values of Incorporating a Multiple‐Choice Question Construction in Physics Experimentation Instruction , 2005 .