Reconsidering assessment in online/hybrid courses: Knowing versus learning

This study explores the influence of assessment on students' online written discussions. A two-by-two design was used to understand students' expression of knowledge and of learning in the contexts of ''regular'' online discussions versus ''final test'' online discussions. Findings suggested that assessment had an impact on how students interacted online and in their use of rhetorical moves; and that knowing and learning are related but distinct constructs, correlated within each writing context, dissociated across contexts, and performing differentially as a function of students' perceptions of academic demands. We discuss the limitations of traditional assessment, offer an alternative approach, and conclude with practical suggestions for online/hybrid course instructors.

[1]  Angela D. Benson.  Assessing participant learning in online environments , 2003 .

[2]  D. Vernon,et al.  Development and Learning , 2014 .

[3]  Curtis J. Bonk,et al.  Content analysis of online discussion in an applied educational psychology course , 2000 .

[4]  M. Hughes,et al.  Towards Constructivism: Investigating Students' Perceptions and Learning as a Result of Using an Online Environment , 2002 .

[5]  Zane L. Berge,et al.  Designing Discussion Questions for Online, Adult Learning. , 2000 .

[6]  S. Herring.  Computer‐Mediated Discourse , 2005 .

[7]  I. E. Allen,et al.  Going the Distance: Online Education in the United States, 2011. , 2011 .

[8]  Bruce W. Speck,et al.  Principles of effective teaching in the online classroom , 2000 .

[9]  Lewis Elton,et al.  Student motivation and achievement , 1988 .

[10]  Rebecca S. Anderson,et al.  Evaluating Students' Written Performance in the Online Classroom , 2000 .

[11]  David Hung,et al.  Personalised knowledge representations: the missing half of online discussions , 2002, Br. J. Educ. Technol..

[12]  Diane L. Schallert,et al.  Online learning or learning on the line: Do students learn anything of value in a computer-mediated discussion. , 2004 .

[13]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[14]  Patricia A. Alexander,et al.  What Is Learning Anyway? A Topographical Perspective Considered , 2009 .

[15]  M. R. Novick.  The axioms and principal results of classical test theory , 1965 .

[16]  Gail A. Herndon.  The chronicle of higher education , 1977 .

[17]  Yangjoo Park,et al.  Being polite while fulfilling different discourse functions in online classroom discussions , 2009, Comput. Educ..

[18]  Joseph J. Pear,et al.  A social constructivist approach to computer-mediated instruction , 2002, Comput. Educ..

[19]  Bruce W. Speck,et al.  Learning‐teaching‐assessment paradigms and the on‐line classroom , 2002 .

[20]  Maggi Savin‐Baden *,et al.  Understanding the impact of assessment on students in problem‐based learning , 2004 .

[21]  Stephen Brookfield,et al.  Discussion as a way of teaching , 1999 .

[22]  Maggi Savin-Baden,et al.  Understanding the impact of assessment on students in problem‐based learning , 2004 .

[23]  Yangjoo Park,et al.  Expressing Uncertainty in Computer-Mediated Discourse: Language as a Marker of Intellectual Work , 2012 .

[24]  J. Young.  Online Classes See Cheating Go High-Tech. , 2012 .

[25]  Alfred P. Rovai,et al.  Online and traditional assessments: what is the difference? , 2000, Internet High. Educ..

[26]  S. Brookfield,et al.  Discussion as a Way of Teaching: Tools and Techniques for Democratic Classrooms , 1999 .

[27]  Robin Goodfellow,et al.  Supporting writing for assessment in online learning , 2005 .

[28]  Jo Davies,et al.  Performance in e-learning: online participation and student grades , 2005, Br. J. Educ. Technol..

[29]  Diane L. Schallert,et al.  Intellectual, Motivational, Textual, And Cultural Considerations In Teaching and Learning With Computer-Mediated Discussion , 2003 .

[30]  Hasan Çakir,et al.  Research in online learning environments: Priorities and methodologies , 2011, Comput. Educ..

[31]  M. J. Allen.  Introduction to Measurement Theory , 1979 .

[32]  Dave S. Knowlton.  Evaluating College Students' Efforts in Asynchronous Discussion: A Systematic Process. , 2003 .

[33]  Seung Youn Chyung,et al.  Applying the "Congruence" Principle of Bloom's Taxonomy to Designing Online Instruction. , 2003 .

[34]  M. David Merrill,et al.  Constructivism and Instructional Design , 1991 .

[35]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[36]  Robin H. Kay,et al.  Developing a comprehensive metric for assessing discussion board effectiveness , 2006, Br. J. Educ. Technol..

[37]  Dawn M. Poole.  Student Participation in a Discussion-Oriented Online Course , 2000 .

[38]  Selma Vonderwell,et al.  Asynchronous Discussions and Assessment in Online Learning , 2007 .

[39]  Janet Macdonald,et al.  Assessing online collaborative learning: process and product , 2003, Comput. Educ..

[40]  L. Elton,et al.  Using the online environment in assessment for learning: a case‐study of a web‐based course in primary care , 2006 .

[41]  Ann M. Solan,et al.  Development, Implementation, and Evaluation of a Grading Rubric for Online Discussions , 2011 .

[42]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[43]  D. Salman,et al.  Development and learning in animals and man. , 1956, The American journal of psychiatry.