Developing laboratory skills by incorporating peer-review and digital badges

Laboratory work is at the core of any chemistry curriculum but literature on the assessment of laboratory skills is scant. In this study we report the use of a peer-observation protocol underpinned by exemplar videos. Students are required to watch exemplar videos for three techniques (titrations, distillations, preparation of standard solutions) in advance of their practical session, and demonstrate the technique to their peer, while being reviewed. For two of the techniques (titrations and distillations), the demonstration was videoed on a mobile phone, which provide evidence that the student has successfully completed the technique. In order to develop digital literacy skills, students are required to upload their videos to a video sharing site for instructor review. The activity facilitated the issuing of digital badges to students who had successfully demonstrated competency. Students’ rating of their knowledge, experience, and confidence of a range of aspects associated with each technique significantly increased as a result of the activity. This work, along with student responses to questions, video access, and observations from implementation are reported in order to demonstrate a novel and useful way to incorporate peer-assessment of laboratory skills into a laboratory programme, as well as the use of digital badges as a means of incorporating and documenting transferable skills on the basis of student generated evidence.

[1]  James K Stoller,et al.  Just imagine: new paradigms for medical education. , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[2]  Michelle M. Rhodes.  A Laboratory Practical Exam for High School Chemistry , 2010 .

[3]  Marcy H. Towns,et al.  Improving and Assessing Student Hands-On Laboratory Skills through Digital Badging , 2016 .

[4]  Marcy H. Towns,et al.  Development, Implementation, and Analysis of a National Survey of Faculty Goals for Undergraduate Chemistry Laboratory , 2013 .

[5]  Edward G. Neeland.  A One-Hour Practical Lab Exam for Organic Chemistry. , 2007 .

[6]  Marcy H. Towns,et al.  General Chemistry Students' Goals for Chemistry Laboratory Coursework. , 2015 .

[7]  Richard L. Weaver,et al.  Peer evaluation: A case study , 1986 .

[8]  Stacey Lowery Bretz,et al.  Faculty Perspectives of Undergraduate Chemistry Laboratory:: Goals and Obstacles to Success , 2010 .

[9]  Marcy H. Towns,et al.  The Digital Pipetting Badge: A Method To Improve Student Hands-On Laboratory Skills , 2015 .

[10]  P. Sadler,et al.  The Impact of Self- and Peer-Grading on Student Learning , 2006 .

[11]  Chin Cheng Chou,et al.  Development and Application of a Scoring Rubric for Evaluating Students’ Experimental Skills in Organic Chemistry: An Instructional Guide for Teaching Assistants , 2013 .

[12]  Dino Spagnoli,et al.  Prepare, Do, Review: a model used to reduce the negative feelings towards laboratory classes in an introductory chemistry undergraduate unit , 2017 .

[13]  Harry Gruppen,et al.  Students Using a Novel Web-Based Laboratory Class Support System: A Case Study in Food Chemistry Education , 2012 .

[14]  Jie-Chi Yang,et al.  Effects of the Badge Mechanism on Self-Efficacy and Learning Performance in a Game-Based English Learning Environment , 2016 .

[15]  Wan Ng,et al.  New Digital Technology in Education , 2015 .

[16]  S. Sawilowsky.  New Effect Size Rules of Thumb , 2009 .

[17]  Marcy H. Towns,et al.  Upper‐level undergraduate chemistry students’ goals for their laboratory coursework , 2016 .

[18]  Vincent N. Lunetta,et al.  The Laboratory in Science Education: Foundations for the Twenty-First Century , 2004 .

[19]  D. Royce,et al.  Sadler, D. R. (2013) 'Opening up feedback: Teaching learners to see'. In Merry, S., Price, M., Carless, D., & Taras, M. (Eds.) Reconceptualising Feedback in Higher Education: developing dialogue with students. (Ch. 5, 54-63). , 2013 .

[20]  N. Reid,et al.  The role of laboratory work in university chemistry , 2007 .

[21]  Wan Ng,et al.  New Digital Technology in Education: Conceptualizing Professional Learning for Educators , 2015 .

[22]  Georgios Tsaparlis,et al.  Student Self-Assessment of Higher-Order Cognitive Skills in College Science Teaching. , 1997 .

[23]  Paul A. Kirschner,et al.  The laboratory in higher science education: Problems, premises and objectives , 1988 .

[24]  Angela Elkordy,et al.  Development and Implementation of Digital Badges for Learning Science, Technologly, Engineering and Math (STEM) Practices in Secondary Contexts: A Pedagogical Approach with Empirical Evidence , 2016 .

[25]  D. Sadler.  Formative assessment and the design of instructional systems , 1989 .

[26]  T. Mikael Winberg,et al.  Students' Cognitive Focus during a Chemistry Laboratory Exercise: Effects of a Computer-Simulated Prelab. , 2007 .

[27]  Gerrylynn K. Roberts.  The Playfair Collection and the teaching of chemistry at the University of Edinburgh 1713–1858 , 1980, History of medicine.

[28]  Michele Lalla,et al.  Fundamental characteristics and statistical analysis of ordinal variables: a review , 2017 .

[29]  Stephen J. Hawkes,et al.  Chemistry Is Not a Laboratory Science , 2004 .

[30]  Brian J. Johnson,et al.  Designing and Conducting a Purification Scheme as an Organic Chemistry Laboratory Practical , 2008 .

[31]  P. Black,et al.  Inside the Black Box: Raising Standards through Classroom Assessment , 2010 .

[32]  Norman Reid,et al.  Enhancing undergraduate chemistry laboratories : pre-laboratory and post-laboratory exercises , 2003 .

[33]  Daniel T. Hickey,et al.  Transcending conventional credentialing and assessment paradigms with information-rich digital badges , 2016, Inf. Soc..

[34]  Stewart B. Kirton,et al.  Using Structured Chemistry Examinations (SChemEs) As an Assessment Method To Improve Undergraduate Students' Generic, Practical, and Laboratory-Based Skills , 2014 .

[35]  Glennys O'Brien,et al.  Analytical Thinking, Analytical Action: Using Prelab Video Demonstrations and e-Quizzes To Improve Undergraduate Preparedness for Analytical Chemistry Practical Classes , 2016 .