Understanding the Engineering Education Research Space Using Interactive Knowledge Networks and Topic Modeling Techniques

For any knowledge intensive undertaking (such as a discipline) it is critical to chart its birth and growth to understand where the discipline stands and what innovative endeavors lead to the creative accomplishments currently witnessed in its knowledge products. In this project report, we describe the research and development of a knowledge platform called Interactive Knowledge Networks for Engineering Education Research (iKNEER). This project was undertaken with the explicit goal to provide a mechanism to better understand the emerging field of Engineering Education Research (EER) and, more importantly, provide members of the Engineering Education Research (EER) community with tools and infrastructure that allows them to understand the structure and networks of knowledge within the community at any given time. Using a theoretical model that combines ultra large-scale data mining techniques, network mapping algorithms, and time-series analysis of knowledge product evolution, we attempt to characterize and provide insights into the topology of the networks and collaborations within engineering education research. We also provide a detailed description of the algorithms, workflows, and the technical architecture we use to make sense of publications, conference proceedings, funding information, and a range of other knowledge products. Finally, we apply topic modeling techniques to a subset of the data to identify the emergence and growth of research topics within the community thereby demonstrating the unique value of this knowledge platform. Overall, the picture of engineering education that emerges from a close inspection of the data shows that the area can be understood as a network of practice where several communities of practice, of which EER is one, interact with each other through loose affiliations. These affiliated groups interact through venues such as conferences and through publishing and reading (thereby citing) same articles and journals. Furthermore, although the collaborative nature of the area is growing and participation in the EER community of practice is increasing, the adoption of core ideas on how to improve engineering education are not swiftly diffusing across other affinity groups. A recent presentation of this work, attached as Appendix A, further outlines both the background and the contributions of this work, particularly in relation to the EER community. The presentation highlights the change in research practices that is occurring in the social sciences due to the availability of digital data and enhanced analysis techniques.

[1]  Peter Bergström,et al.  Augmenting the exploration of digital libraries with web-based visualizations , 2009, 2009 Fourth International Conference on Digital Information Management.

[2]  Va Arlington National Science Board. , 2010 .

[3]  K. Smith,et al.  Conducting Rigorous Research in Engineering Education , 2006 .

[4]  Carl Lagoze,et al.  Detecting research topics via the correlation between graphs and texts , 2007, KDD '07.

[5]  Lee S. Shulman,et al.  If Not Now, When? The Timeliness of Scholarship of the Education of Engineers , 2005 .

[6]  Andrew McCallum,et al.  Topics over time: a non-Markov continuous-time model of topical trends , 2006, KDD '06.

[7]  J. March Exploration and exploitation in organizational learning , 1991, STUDI ORGANIZZATIVI.

[8]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Lynita K. Newswander,et al.  Engineering Education Research: Discipline, Community, or Field? , 2009 .

[10]  Katherine W. McCain,et al.  Mapping authors in intellectual space: A technical overview , 1990, Journal of the American Society for Information Science.

[11]  Katherine W. McCain,et al.  Visualizing a Discipline: An Author Co-Citation Analysis of Information Science, 1972-1995 , 1998, J. Am. Soc. Inf. Sci..

[12]  Krishna Madhavan,et al.  Evaluating The Effectiveness And Use Of Cyber Learning Environments In Engineering Education: A Qualitative Analysis , 2009 .

[13]  Thomas L. Griffiths,et al.  The Author-Topic Model for Authors and Documents , 2004, UAI.

[14]  Andrew McCallum,et al.  The Author-Recipient-Topic Model for Topic and Role Discovery in Social Networks: Experiments with Enron and Academic Email , 2005 .

[15]  David S. Ebert,et al.  WordBridge: Using Composite Tag Clouds in Node-Link Diagrams for Visualizing Content and Relations in Text Corpora , 2011, 2011 44th Hawaii International Conference on System Sciences.

[16]  Sandra Ingram,et al.  Career and Mentor Satisfaction among Canadian Engineers: Are there Differences based on Gender and Company‐Specific Undergraduate Work Experiences? , 2009 .

[17]  Daniel A. Keim,et al.  Document Cards: A Top Trumps Visualization for Documents , 2009, IEEE Transactions on Visualization and Computer Graphics.

[18]  Victoria S. Uren,et al.  Sensemaking tools for understanding research literatures: Design, implementation and user evaluation , 2006, Int. J. Hum. Comput. Stud..

[19]  Aditya Johri,et al.  Creating Theoretical Insights in Engineering Education , 2010 .

[20]  Sarah A. Rajala,et al.  Retention of Undergraduate Engineering Students: Extending Research Into Practice , 2010 .

[21]  Francisco J. Acedo,et al.  Current paradigms in the international management field: an author co-citation analysis , 2005 .

[22]  Spencer P. Magleby,et al.  A Review of Literature on Teaching Engineering Design Through Project‐Oriented Capstone Courses , 1997 .

[23]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[24]  Norman Fortenberry,et al.  An Extensive Agenda for Engineering Education Research , 2006 .

[25]  S. C. Hui,et al.  Mining a Web Citation Database for author co-citation analysis , 2002, Inf. Process. Manag..

[26]  Daniel Atkins,et al.  Revolutionizing Science and Engineering Through Cyberinfrastructure: Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure , 2003 .

[27]  Henry G. Small,et al.  Visualizing Science by Citation Mapping , 1999, J. Am. Soc. Inf. Sci..

[28]  Phillip C. Wankat,et al.  Analysis of the First Ten Years of the Journal of Engineering Education , 2004 .

[29]  Henry G. Small,et al.  A SCI-Map case study: Building a map of AIDS research , 1994, Scientometrics.

[30]  Daniel Jurafsky,et al.  Studying the History of Ideas Using Topic Models , 2008, EMNLP.

[31]  Maura Borrego,et al.  Expanding global engineering education research collaboration , 2008 .

[32]  Chaomei Chen,et al.  Visualizing knowledge domains , 2005, Annu. Rev. Inf. Sci. Technol..

[33]  K. Börner,et al.  Mapping topics and topic bursts in PNAS , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[34]  P. Wankat An Analysis of the Articles in the Journal of Engineering Education , 1999 .

[35]  Kevin W. Boyack,et al.  Domain visualization using VxInsight® for science and technology management , 2002, J. Assoc. Inf. Sci. Technol..

[36]  Michael J. Prince,et al.  Does Active Learning Work? A Review of the Research , 2004 .

[37]  Hugh C. Davis,et al.  Hypertext'99 : Returning to our Diverse Roots : Proceedings of the 10th ACM Conference on Hypertext and Hypermedia, Darmstadt, Germany, February 21-25, 1999 , 1999 .

[38]  Thomas L. Griffiths,et al.  Probabilistic author-topic models for information discovery , 2004, KDD.

[39]  WebsterJane,et al.  Analyzing the past to prepare for the future , 2002 .

[40]  Katherine W. McCain,et al.  Visualizing a discipline: an author co-citation analysis of information science, 1972–1995 , 1998 .

[41]  Karan Watson Change in Engineering Education: Where Does Research Fit? , 2009 .