Standardised library instruction assessment: an institution-specific approach

Introduction. We explore the use of a psychometric model for locally-relevant, information literacy assessment, using an online tool for standardised assessment of student learning during discipline-based library instruction sessions. Method. A quantitative approach to data collection and analysis was used, employing standardised multiple-choice survey questions followed by individual, cognitive interviews with undergraduate students. The assessment tool was administered to five general education psychology classes during library instruction sessions. Analysis. Descriptive statistics were generated by the assessment tool. Results. The assessment tool proved a feasible means of measuring student learning. While student scores improved on every survey question, there was uneven improvement from pre-test to post-test for different questions. Conclusion. Student scores showed more improvement for some learning outcomes over others, thus, spending time on fewer concepts during instruction sessions would enable more reliable evaluation of student learning. We recommend using digital learning objects that address basic research skills to enhance library instruction programmes. Future studies will explore different applications of the assessment tool, provide more detailed statistical analysis of the data and shed additional light on the significance of overall scores.

[1]  Bronwyn F. Ewing Digital Learning Objects , 2009 .

[2]  Chris A. Portmann,et al.  Assessing the effects of library instruction , 2004 .

[3]  Janet L. Williams Creativity in assessment of library instruction , 2000 .

[4]  Francis Howard,et al.  Digital learning objects: a local response to the California State University system initiative , 2009 .

[5]  James D. Hansen,et al.  Quality Multiple-Choice Test Questions: Item-Writing Guidelines and an Analysis of Auditing Testbanks , 1997 .

[6]  Jason Dupree,et al.  Assessing Learning, Critical Reflection, and Quality Educational Outcomes: The Critical Incident Questionnaire , 2008 .

[7]  G. Willis,et al.  Research Synthesis: The Practice of Cognitive Interviewing , 2007 .

[8]  Donald A. Barclay Evaluating Library Instruction: Doing the Best You Can With What You Have , 1993 .

[9]  E. McColl Cognitive Interviewing. A Tool for Improving Questionnaire Design , 2006, Quality of Life Research.

[10]  Using a Reciprocal Teaching StrategyTo Create Multiple-Choice Exam Questions , 2006 .

[11]  Patricia A Iannuzzi Information Literacy Competency Standards for Higher Education , 2000 .

[12]  Judith A. Ouimet,et al.  Using Focus Groups, Expert Advice, and Cognitive Interviews to Establish the Validity of a College Student Survey , 2004 .

[13]  Elizabeth W. Carter "Doing the Best You Can with What You Have:" Lessons Learned from Outcomes Assessment. , 2002 .

[14]  J. M. Collins Becoming a Critically Reflective Teacher , 1997 .

[15]  Kay J. Andersen Western Association of Schools and Colleges. , 1978 .

[16]  Kristen Hughes Comparing Pretesting Methods: Cognitive Interviews, Respondent Debriefing, and Behavior Coding , 2004 .

[17]  S. Wise,et al.  The Development and Validation of the Information Literacy Test , 2007 .

[18]  Mary M. Somerville,et al.  The ETS iSkillsTM Assessment: a digital age tool , 2008, Electron. Libr..

[19]  D. Cournoyer,et al.  Research Methods for Social Work , 1999 .

[20]  Barbara F. Schloman,et al.  Creating Trails: Tool for Real-Time Assessment of Information Literacy Skills. , 2007 .

[21]  P. Jackson Plagiarism Instruction Online: Assessing Undergraduate Students’ Ability to Avoid Plagiarism , 2006 .

[22]  Michael Lorenzen,et al.  We Won't Be Fooled Again: Teaching Critical Thinking via Evaluation of Hoax and Historical Revisionist Websites in a Library Credit Course , 2008 .

[23]  Megan Oakleaf Dangers and Opportunities: A Conceptual Map of Information Literacy Assessment Approaches , 2008 .

[24]  Laura M. Desimone,et al.  Are We Asking the Right Questions? Using Cognitive Interviews to Improve Surveys in Education Research , 2004 .

[25]  Joseph A. Salem,et al.  A Practical Guide to Information Literacy Assessment for Academic Librarians , 2007 .

[26]  An Nguyen,et al.  Contents | Author index | Subject index | Search | Home , 2011 .

[27]  Adam M Persky,et al.  Using answer-until-correct examinations to provide immediate feedback to students in a pharmacokinetics course. , 2008, American journal of pharmaceutical education.

[28]  J. Erzen Islamic Aesthetics: An Alternative Way to Knowledge , 2007 .

[29]  Natalie Mansfield The Final Hurdle , 2008 .

[30]  Julie Watson,et al.  A Case Study: Developing Learning Objects with an Explicit Learning Design. , 2010 .

[31]  Lorrie Knight,et al.  The role of assessment in library user education , 2002 .

[32]  Earl R. Babbie,et al.  Research methods for social work , 2010 .

[33]  Boyd Koehler,et al.  ESL Students and Bibliographic Instruction: Learning Yet Another Language. , 1988 .

[34]  Gordon W. Smith,et al.  Information and communication technology literacy : New assessments for higher education , 2005 .

[35]  Brian Winterman,et al.  Throw Away the Map: Blazing New Trails between Information Literacy and the Disciplines , 2009 .