Development of a Taxonomy of Keywords for Engineering Education Research

The diversity of engineering education research provides an opportunity for cross-fertilization of ideas and creativity, but it also can result in fragmentation of the field and duplication of effort. One solution is to establish a standardized taxonomy of engineering education terms to map the field and communicate and connect research initiatives. This report describes the process for developing such a taxonomy, the EER Taxonomy. Although the taxonomy focuses on engineering education research in the United States, inclusive efforts have engaged 266 individuals from 149 cities in 30 countries during one multiday workshop, seven conference sessions, and several other virtual and in-person activities. The resulting taxonomy comprises 455 terms arranged in 14 branches and six levels. This taxonomy was found to satisfy four criteria for validity and reliability: (1) keywords assigned to a set of abstracts were reproducible by multiple researchers, (2) the taxonomy comprised terms that could be selected as keywords to fully describe 243 articles in three journals, (3) the keywords for those 243 articles were evenly distributed across the branches of the taxonomy, and (4) the authors of 31 conference papers agreed with 90% of researcher-assigned keywords. This report also describes guidelines developed to help authors consistently assign keywords for their articles by encouraging them to choose terms from three categories: (1) context/focus/topic, (2) purpose/target/motivation, and (3) research approach.

[1]  D. P. Dash,et al.  Introducing a concept hierarchy for the Journal of Research Practice , 2011 .

[2]  S. Sheppard,et al.  Taking Stock: An Analysis of the Publishing Record as Represented by the Journal of Engineering Education , 2004 .

[3]  Anette Kolmos,et al.  Innovation and Research on Engineering Education , 2014 .

[4]  Phillip C. Wankat,et al.  Analysis of the First Ten Years of the Journal of Engineering Education , 2004 .

[5]  Cynthia J. Finelli,et al.  An Inclusive Process for Developing a Taxonomy of Keywords for Engineering Education Research , 2014 .

[6]  Maura Borrego,et al.  Mapping global trends in engineering education research , 2011 .

[7]  Jonte Bernhard,et al.  The Emergence of Engineering Education Research as an Internationally Connected Field of Inquiry , 2011 .

[8]  Maura Borrego,et al.  Development of Engineering Education as a Rigorous Discipline: A Study of the Publication Patterns of Four Coalitions , 2007 .

[9]  Krishna Madhavan,et al.  Anatomy of Scholarly Collaboration in Engineering Education: A Big‐Data Bibliometric Analysis , 2014 .

[10]  Yordan Kalmukov Describing papers and reviewers' competences by taxonomy of keywords , 2012, Comput. Sci. Inf. Syst..

[11]  Lyn Robinson,et al.  Ontological realism, concepts and classification in molecular biology: Development and application of the gene ontology , 2014, J. Documentation.

[12]  Lauri Malmi,et al.  Methodological Analysis of SEFI EER papers , 2013 .

[13]  Lynita K. Newswander,et al.  Engineering Education Research: Discipline, Community, or Field? , 2009 .

[14]  Thomas Pack The disconnect continues , 2002 .

[15]  Lauri Malmi,et al.  Developing a methodological taxonomy of EER papers , 2012 .

[16]  Donald T. Hawkins,et al.  Information science abstracts: Tracking the literature of information science. Part 2: A new taxonomy for information science , 2003, J. Assoc. Inf. Sci. Technol..

[17]  Cynthia J. Finelli Refining a taxonomy for engineering education research , 2013, 2013 IEEE Frontiers in Education Conference (FIE).

[18]  Qing Liu,et al.  Designing Discovery Experience for Big Data Interaction: A Case of Web-Based Knowledge Mining and Interactive Visualization Platform , 2013, HCI.

[19]  Jennifer M. Case,et al.  Emerging Research Methodologies in Engineering Education Research , 2011 .

[20]  Prateek Shekhar,et al.  A classroom observation instrument to assess student response to active learning , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[21]  Mary Besterfield-Sacre,et al.  Changing Engineering Education: Views of U.S. Faculty, Chairs, and Deans , 2014 .

[22]  Esat Alpay,et al.  Engineering education in research-intensive universities , 2012 .

[23]  P. Wankat An Analysis of the Articles in the Journal of Engineering Education , 1999 .

[24]  Cynthia J. Finelli,et al.  Using and disseminating a taxonomy for engineering education research , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[25]  Thomas Pack Taxonomy's role in content management , 2002 .

[26]  D. P. Dash,et al.  On Reflecting and Making in Artistic Research , 2011 .

[27]  Jeffrey E. Froyd,et al.  Five Major Shifts in 100 Years of Engineering Education , 2012, Proceedings of the IEEE.