A quantitative investigation into whether the publication of engineering pedagogical material is an indicator of value in 'Rankings' when assessing instruction

Academic departments, colleges and universities are ranked by a variety of agencies, all utilizing different criteria. Arguments abound over how these rankings can and should be compiled. Because there are a variety of consumers who are impacted by these rankings and use them as a basis in their decision making processes, cries of foul play can usually be heard in the hollow halls of academia upon the latest release of such rankings; in fact, the more popular the ranking, the louder the cry. While there is a general consensus that academic numerical rankings are inherently flawed, they are used. Prospective students may use the rankings to inform their decision when selecting a school to attend; some faculty consult these guides when contemplating career moves, and administrators use these rankings for their institution's own self-promoting activities. This paper will examine the practice of ranking undergraduate college and university engineering programs and document whether those rankings track with the pedagogical development of the discipline. On the one hand, one can successfully argue that overall research expenditures at the graduate level aid undergraduates by giving them access to cutting edge research in their chosen discipline. On the other hand, the availability of research funds does not guarantee undergraduates access to research opportunities. Therefore we make the claim that students in programs where the pedagogical development of the discipline is occurring will generally receive a better educational experience. It is our contention that faculty who drive the educational resource development in their disciplines are generally better educators than those that focus primarily on research. We examine literature citations involving the pedagogical development of engineering and correlate those findings with engineering undergraduate school rankings using a popular magazine rating service. We find that the rankings of schools do not correlate with the number of educational development references, implying that the rankings are missing a key component in the undergraduate educational experience.

[1]  J. Fredericks Volkwein,et al.  The Impact of Departmental Research and Teaching Climates on Undergraduate Growth and Satisfaction. , 1994 .

[2]  Graham Gibbs,et al.  Promoting Excellent Teaching is Harder Than You'D Think , 1995 .

[3]  Manjulika Koshal,et al.  Research Grants and School Ranking of PhD Granting Institutions: A Simultaneous Equations Model , 1996 .

[4]  Lynn C. Hattendorf Educational Rankings of Higher Education: Fact or Fiction?. , 1996 .

[5]  Richard W. Moll,et al.  What College Selectivity Looks Like to the Public. , 1998 .

[6]  D. Cohen,et al.  Magazine's Rankings of Asian Universities are Popular with Readers, Not Academics. , 1999 .

[7]  Ronald G. Ehrenberg,et al.  Does It Pay To Attend an Elite Private College? Evidence on the Effects of Undergraduate College Quality on Graduate School Attendance. , 1998 .

[8]  MaryBeth Walpole,et al.  National Rankings: Ramifications for Academic Units. , 1998 .

[9]  K. Feldman Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration , 1987 .

[10]  Roy Boyd,et al.  Tuition at PhD-Granting Institutions: A Supply and Demand Model. , 1994 .

[11]  Stephen D. Grunig,et al.  Research, Reputation, and Resources: The Effect of Research Activity on Perceptions of Undergraduate Education and Institutional Resource Acquisition. , 1997 .

[12]  Arthur Stephen When Rankings Rankle. , 1999 .

[13]  Kim Strosnider Study Measures Influence of College Rankings. , 1997 .

[14]  S. Page,et al.  Rankings of Canadian Universities: Pitfalls in Interpretation. , 1995 .

[15]  James C. Baughman,et al.  College Rankings and Faculty Publications: Are They Related? , 1999 .

[16]  B. Ann Wright A Little Learning Is a Dangerous Thing: A Look at Two Popular College Rankings. , 1992 .

[17]  Patrick T. Terenzini,et al.  Living with Myths: Undergraduate Education in America , 1994 .

[18]  Cleve Latham College Ratings: How Do You Like It?. , 1989 .

[19]  Anne Machung,et al.  Playing the Rankings Game. , 1998 .

[20]  Jeff Anstine,et al.  Critical mass in the production of Ph.D.s: a multi-disciplinary study , 2002 .

[21]  Marguerite Clarke Quantifying Quality: Technical Issues Surrounding "U.S. News and World Report's" Rankings of U.S. Colleges and Graduate Schools. , 2001 .

[22]  Thomas Li-Ping Tang,et al.  Factors related to university presidents' pay: An examination of private colleges and universities , 2000 .

[23]  Mitchell J. Chang,et al.  Colleges That Emphasize Research and Teaching: Can You Have Your Cake and Eat It Too? , 1995 .