Quantifying and assessing learning objectives

A number of studies have been conducted which use the Bloom taxonomy to improve teaching and learning. However, to our knowledge, neither the Bloom taxonomy nor any other established learning taxonomy has been used as a basis to develop a quantifiable tool that will enable teachers to analyse the cognitive process embedded in the objectives and assessment of a subject, as well as provide a methodology to assess alignment of those objectives with the assessment tasks. This paper presents the development of such a quantifiable tool. We discuss the assumptions, method and potential benefits of the outlined approach and in particular its value in providing a mechanism for comparison between subjects, both over time for a given subject and between subjects. The approach has been applied to a specific example in the education system of a profession, the Institute of Actuaries of Australia. The approach is not mathematically difficult to develop. The model requires a number of parameters to be specified. Once these parameters are specified then the methodology is robust. Adjustments to results are made by explicit adjustments to the parameters and not the methodology. A key consequence of this is that once the methodology is accepted, results and any changes can be explicitly tracked and the causes unambiguously identified. In environments where subjective opinion may be pronounced, such an approach raises the level and quality of discussion significantly from ‘shooting the messenger’ to ‘addressing the message’. We also comment on the potential for extensions of this work. In an economic and educational environment where teachers are being held more accountable for the attainment of promised learning outcomes for their students the development of the tool proposed here is potentially powerful and widely applicable.

[1]  A. Biglan Relationships between subject matter characteristics and the structure and output of university departments. , 1973 .

[2]  Tony Becher,et al.  Teaching and Learning in their Disciplinary Contexts: A conceptual analysis , 2002 .

[3]  N. Entwistle,et al.  EFFECTS OF ACADEMIC DEPARTMENTS ON STUDENTS' APPROACHES TO STUDYING , 1981 .

[4]  P. Ramsden,et al.  THE EXPERIENCE OF LEARNING THE CONTEXT OF LEARNING IN ACADEMIC DEPARTMENTS 199198 CHAPTER THIRTEEN The Context of Learning in Academic Departments , 2005 .

[5]  David S. Moore,et al.  Reconsidering Bloom's Taxonomy of Educational Objectives, Cognitive Domain. , 1982 .

[6]  K. Trigwell,et al.  Relations between teachers' approaches to teaching and students' approaches to learning , 1999 .

[7]  Mark J. Gierl Comparing Cognitive Representations of Test Developers and Students on a Mathematics Test With Bloom's Taxonomy , 1997 .

[8]  Cindy Evans Improving Test Practices to Require and Evaluate Higher Levels of Thinking , 1999 .

[9]  W. Hansen,et al.  Expected Proficiencies for Undergraduate Economics Majors , 2001 .

[10]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[11]  Linda R. Sanders Improving Assessment in University Classrooms , 2001 .

[12]  Tony Becher,et al.  Academic Tribes and Territories: Intellectual Enquiry and the Cultures of Disciplines , 2001 .

[13]  J. Donald,et al.  Disciplinary differences in knowledge validation , 1995 .

[14]  D. Krathwohl A Revision of Bloom's Taxonomy: An Overview , 2002 .

[15]  Joan S. Stark,et al.  Modifying the Major: Discretionary Thoughts from Ten Disciplines , 2017 .

[16]  Seth Kunen,et al.  A Levels-of-Processing Analysis of Bloom's Taxonomy. , 1981 .

[17]  John M. Braxton,et al.  An Alternative Definition of Quality of Undergraduate College Education: Toward Usable Knowledge for Improvement , 1996 .

[18]  A. Biglan The characteristics of subject matter in different academic areas. , 1973 .

[19]  J. Kottke,et al.  Developing Tests for Measuring Bloom's Learning Outcomes , 1990 .

[20]  D. Hounsell The Experience of Learning: Implications for Teaching and Studying in Higher Education , 1997 .

[21]  Lorin W. Anderson,et al.  Curricular Alignment: A Re-Examination , 2002 .

[22]  David Kember,et al.  Orientations to Teaching and Their Effect on the Quality of Student Learning , 1994 .

[23]  Darcy Haag Granello,et al.  Promoting Cognitive Complexity in Graduate Written Work: Using Bloom's Taxonomy as a Pedagogical Tool to Improve Literature Reviews , 2001 .

[24]  Lisa R. Lattuca,et al.  Will Disciplinary Perspectives Impede Curricular Reform , 1994 .

[25]  J. Biggs,et al.  Teaching For Quality Learning At University , 1999 .

[26]  P. Pintrich The Role of Metacognitive Knowledge in Learning, Teaching, and Assessing , 2002 .