Modeling and Measuring Competencies in Higher Education

Measuring competencies acquired in higher education has to be regarded as a widely neglected research field. The progress made in empirical research on the school system since the 1990s – for example, through large-scale assessments such as the Trends in International Mathematics and Science Study (TIMSS) and the Programme for International Student Assessment (PISA) and through a massive expansion of instructional research in general – has revealed that nothing comparable exists at the higher education level.

[1]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[2]  Richard J Shavelson,et al.  Effect of lunar gravity on man's performance of basic maintenance tasks. , 1968, The Journal of applied psychology.

[3]  R. Harden,et al.  Assessment of clinical competence using objective structured examination. , 1975, British medical journal.

[4]  M. Kane.  A Sampling Model for Validity , 1982 .

[5]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[6]  Noreen M. Webb,et al.  Reliability (generalizability) of job performance measurements: Navy machinist mates. , 1989 .

[7]  G. Miller.  The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[8]  D. Kuhn.  THE SKILLS OF ARGUMENT , 2008, Education for Thinking.

[9]  Richard J. Shavelson,et al.  Generalizability Theory: A Primer , 1991 .

[10]  Bert F. Green,et al.  Performance assessment for the workplace , 1991 .

[11]  Noreen M. Webb,et al.  Generalizability theory : 1973-1980 , 1991 .

[12]  R. Shavelson.  Performance Assessment in Science , 1991 .

[13]  S. Wineburg.  Historical Problem Solving: A Study of the Cognitive Processes Used in the Evaluation of Documentary and Pictorial Evidence , 1991 .

[14]  K. A. Ericsson,et al.  Protocol analysis: Verbal reports as data, Rev. ed. , 1993 .

[15]  R. Shavelson,et al.  Sampling Variability of Performance Assessments. , 1993 .

[16]  Douglas B. McLeod,et al.  Research on affect and mathematics learning in the JRME: 1970 to the present. , 1994 .

[17]  Gail P. Baxter,et al.  Science performance assessments: benchmarks and surrogates , 1994 .

[18]  R. Shavelson,et al.  Rhetoric and reality in science performance assessments: An update. , 1996 .

[19]  Carol H. Weiss,et al.  Have we learned anything new about the use of evaluation , 1998 .

[20]  Maria Araceli Ruiz-Primo,et al.  Note On Sources of Sampling Variability in Science Performance Assessments , 1999 .

[21]  R. Shavelson,et al.  On the Validity of Cognitive Interpretations of Scores From Alternative Concept-Mapping Techniques , 2001 .

[22]  Gregory J. Cizek,et al.  Setting performance standards : concepts, methods, and perspectives , 2001 .

[23]  Christopher R. Wolfe,et al.  Learning and Teaching on the World Wide Web , 2001 .

[24]  Dominique Simone Rychen,et al.  Defining and selecting key competencies. , 2001 .

[25]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[26]  M. Anne Britt,et al.  Teaching Advanced Literacy Skills for the World Wide Web , 2001 .

[27]  Gary D. Phye,et al.  Problem-solving instruction and problem-solving transfer : The correspondence issue , 2001 .

[28]  Franz Emanuel Weinert,et al.  Concept of competence: A conceptual clarification , 2001 .

[29]  M. Ashcraft.  Math Anxiety: Personal, Educational, and Cognitive Consequences , 2002 .

[30]  Jürgen Baumert,et al.  Learners for Life. Student Approaches to Learning. Results from PISA 2000. , 2003 .

[31]  Jane Watson,et al.  STATISTICAL LITERACY: A COMPLEX HIERARCHICAL CONSTRUCT 1 , 2003 .

[32]  Edward H. Haertel,et al.  Validating Standards-Based Test Score Interpretations , 2004 .

[33]  Joan Garfield,et al.  The challenge of developing statistical literacy, reasoning and thinking , 2004 .

[34]  Thomas Brüsemeister,et al.  Merkmale und Fragen einer Governance-Reform am Beispiel des österreichischen Schulwesens , 2005 .

[35]  Jacqueline P. Leighton.  Avoiding Misconception, Misuse, and Missed Opportunities: The Collection of Verbal Reports in Educational Achievement Testing , 2005 .

[36]  Anat Yarden,et al.  Text genre as a factor in the formation of scientific literacy , 2005 .

[37]  Kultusministerkonferenz.  Bildungsstandards im Fach Biologie für den Mittleren Schulabschluss (Jahrgangsstufe 10) , 2005 .

[38]  D. Bell,et al.  Instruments for evaluating education in evidence-based practice: a systematic review. , 2006, JAMA.

[39]  S. Holden.  Education at a Glance , 2006, The SAGE Encyclopedia of Higher Education.

[40]  Jean-François Rouet,et al.  The Skills of Document Use: From Text Comprehension to Web-Based Learning , 2006 .

[41]  D. Kuhn,et al.  The Second Decade: What Develops (and How) , 2007 .

[42]  Joanna S. Gorin.  Test Design with Cognition in Mind , 2007 .

[43]  Robert J. Mislevy,et al.  Implications of Evidence‐Centered Design for Educational Testing , 2007 .

[44]  Roger Bolus,et al.  The Collegiate Learning Assessment , 2007, Evaluation review.

[45]  Randall E. Groth.  Toward a Conceptualization of Statistical Knowledge for Teaching. , 2007 .

[46]  Gary Shank,et al.  Exploring Educational Research Literacy , 2007 .

[47]  James A. Coleman,et al.  Motivation of UK school pupils towards foreign languages: a large-scale survey at Key Stage 3 , 2007 .

[48]  Nicole B. Kersting,et al.  Using Video Clips of Mathematics Classroom Instruction as Item Prompts to Measure Teachers' Knowledge of Teaching Mathematics , 2008 .

[49]  Methoden und Probleme bei der Entwicklung instruktionspsychologischer Ansätze zur Unterrichtsgestaltung , 2008 .

[50]  Gilah C. Leder,et al.  ZDM - The International Journal on Mathematics Education , 2008 .

[51]  John Hattie,et al.  Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement , 2008 .

[52]  Megan Oakleaf.  Dangers and Opportunities: A Conceptual Map of Information Literacy Assessment Approaches , 2008 .

[53]  J. Templin,et al.  Unique Characteristics of Diagnostic Classification Models: A Comprehensive Review of the Current State-of-the-Art , 2008 .

[54]  G. Boulton‐Lewis.  Teaching for quality learning at university , 2008 .

[55]  Stephen P. Klein,et al.  Characteristics of hand and machine-assigned scores to college students’ answers to open-ended tasks , 2008, 0805.2829.

[56]  Jihyun Lee,et al.  Universals and Specifics of Math Self-Concept, Math Self-Efficacy, and Math Anxiety across 41 PISA 2003 Participating Countries. , 2009 .

[57]  I. Gogolin.  Zweisprachigkeit und die Entwicklung bildungssprachlicher Fähigkeiten , 2009 .

[58]  Gavin T. L. Brown,et al.  The complexity of teachers’ conceptions of assessment: tensions between the needs of schools and students , 2009 .

[59]  Eduardo Vidal-Abarca,et al.  Impact of Question-Answering Tasks on Search Processes and Reading Comprehension. , 2009 .

[60]  Sandra Johnson,et al.  Applying Generalizability Theory using EduG , 2009 .

[61]  Hartmut Ditton.  Evaluation und Qualitätssicherung , 2009 .

[62]  Johannes Hartig,et al.  Multidimensional IRT models for the assessment of competencies , 2009 .

[63]  Stephen P. Norris,et al.  West Nile Virus: Using Adapted Primary Literature in Mathematical Biology to Teach Scientific and Mathematical Reasoning in High School , 2009 .

[64]  Erin Marie Furtak,et al.  The Evidence-Based Reasoning Framework: Assessing Scientific Reasoning , 2010 .

[65]  S. Borg.  Language teacher research engagement , 2010, Language Teaching.

[66]  Richard J. Shavelson,et al.  On the measurement of competency , 2010 .

[67]  Michael J. Timms,et al.  A Framework for Analyzing Scientific Reasoning in Assessments , 2010 .

[68]  Paul Barach,et al.  When Do Supervising Physicians Decide to Entrust Residents With Unsupervised Tasks? , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[69]  Feng-Jui Hsieh,et al.  Mathematics Teacher Education Quality in TEDS-M: Globalizing the Views of Future Teachers and Teacher Educators , 2011 .

[70]  Sigrid Blömeke,et al.  Teacher Education Effectiveness: Quality and Equity of Future Primary Teachers' Mathematics and Mathematics Pedagogical Content Knowledge. , 2011 .

[71]  R. Cavanagh,et al.  Situational effects of mathematics anxiety in pre-service teacher education , 2011 .

[72]  Dale H. Schunk,et al.  Self-Regulated Learning and Performance : An Introduction and an Overview , 2011 .

[73]  Building structures by research funding?: DFG’s programme in the field of empirical research in education , 2011 .

[74]  F. Copland,et al.  L1 to teach L2: complexities and contradictions , 2011 .

[75]  Michael Kerres,et al.  Mediendidaktik: Konzeption und Entwicklung mediengestützter Lernangebote , 2012 .

[76]  M. Anne Britt,et al.  Relevance processes in multiple document comprehension , 2012 .

[77]  R. Grundmann,et al.  The Power of Scientific Knowledge: From Research to Public Policy , 2012 .

[78]  Sigrid Blömeke,et al.  Homogeneity or heterogeneity? Profiles of opportunities to learn in primary teacher education and their relationship to cultural context and outcomes , 2012 .

[79]  I. Arnold,et al.  Motivation and Math Skills as Determinants of First-Year Performance in Economics , 2012 .

[80]  Stephen P. Norris,et al.  Teaching Mathematical Biology in High School Using Adapted Primary Literature , 2012 .

[81]  Gabriele Kaiser,et al.  Family Background, Entry Selectivity and Opportunities to Learn: What Matters in Primary Teacher Education? An International Comparison of Fifteen Countries , 2012 .

[82]  M. Kane.  Validating the Interpretations and Uses of Test Scores , 2013 .

[83]  Sigrid Blömeke,et al.  Modeling and Measuring Competencies in Higher Education: Tasks and Challenges , 2013 .

[84]  Thaddeus Metz.  The Aims of HIgher Education , 2013 .

[85]  Jonathan Evans,et al.  Science Perspectives on Psychological , 2022 .

[86]  Seoyeon Lee,et al.  Why read online news? the structural relationships among motivations, behaviors, and consumption in South Korea , 2013 .

[87]  Causal Inference in Educational Research : Approaches, Assumptions and Limitations , 2013 .

[88]  „Frühe Bildung“ – Ergebnisse einer längsschnittlichen Befragung , 2013 .

[89]  Stuart T Haines,et al.  An objective structured teaching examination (OSTE) for faculty development , 2013 .

[90]  D. Eignor.  The standards for educational and psychological testing. , 2013 .

[91]  Studienabbrüche an Schweizer Universitäten , 2013 .

[92]  J. Mayer,et al.  Wissenschaftliches Denken beim Experimentieren – Kompetenzdiagnose in der Sekundarstufe II , 2013 .

[93]  V. Shute,et al.  Stealth Assessment: Measuring and Supporting Learning in Video Games , 2013 .

[94]  S. Krauss,et al.  Cognitive Activation in the Mathematics Classroom and Professional Competence of Teachers , 2013 .

[95]  K. Cortina,et al.  Teacher Education in Germany , 2013 .

[96]  M. Anne Britt,et al.  Scientific Literacy: The Role of Goal-Directed Reading and Evaluation in Understanding Scientific Information , 2014 .

[97]  Timothy J. Wood,et al.  Exploring the role of first impressions in rater-based assessments , 2014, Advances in health sciences education : theory and practice.

[98]  Marianne Nolte,et al.  Introvision zur Reduktion von Mathematikangst bei Lehramtsstudierenden , 2014 .

[99]  Validitätsaspekte von Kompetenzmodellen und -tests für hochschulische Kompetenzdomänen , 2014 .

[100]  J. Gustafsson,et al.  Beyond dichotomies: Competence viewed as a continuum , 2015 .

[101]  Insights from a German assessment of business and economics competence , 2015 .

[102]  T. Tofade,et al.  An objective structured teaching exercise (OSTE) for preceptor development , 2015 .

[103]  Albert Ziegler,et al.  Competencies for successful self-regulated learning in higher education: structural model and indications drawn from expert interviews , 2015 .

[104]  Andreas Nehring,et al.  Predicting Students’ Skills in the Context of Scientific Inquiry with Cognitive, Motivational, and Sociodemographic Variables , 2015 .

[105]  J. König,et al.  Analyse von schriftlichen Unterrichtsplanungen: Empirische Befunde zur didaktischen Adaptivität als Aspekt der Planungskompetenz angehender Lehrkräfte , 2015 .

[106]  A. Lindmeier,et al.  Beyond Knowledge: Measuring Primary Teachers’ Subject-Specific Competences in and for Teaching Mathematics with Items Based on Video Vignettes , 2015 .

[107]  Huiju Carrie Chen,et al.  Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99 , 2015, Medical teacher.

[108]  Aleksandar Stojanovic,et al.  Critical Thinking of Students – Indicator of Quality in Higher Education , 2015 .