PhD Students' Evaluations of Research Supervision

This article is based on an earlier paper commissioned and distributed by the Australian Council of Deans and Directors of Graduate Students and presented to a meeting of Australian Pro Vice Chancellors of Research and, subsequently, at the Postgraduate Research Experience Questionnaire (PREQ) Seminar that was organized by the Graduate Careers Council of Australia in association with the Australian Department of Education, Training, and Youth Affairs. We would like to thank the Australian Council for Educational Research and Bruce Guthrie of the Graduate Careers Council of Australia who provided us with draft reports and the data used in this article. In addition, we would like to acknowledge the Australian Council of Educational Research for their work in assembling and preparing data files that facilitated our research and for earlier analyses of these data conducted by Gerry Elsworth, Adrian Harvey-Beavis, and Sue Fullarton. We would also like to thank Kit-Tai Hau, Kate Johnson, Wijesir Jayasinghe, and members of the Australian Council of Deans and Directors of Graduate Studies for helpful comments on earlier versions of this draft. We emphasize, however, that our interpretations of the results are our responsibility and may not be in agreement with those of persons and organizations whom we have acknowledged. This research was funded in part through a grant to the first author from the Australian Research Council. Correspondence in relation to this article should be sent to Professor Herbert W. Marsh, SELF Research Centre, Bankstown Campus, University of Western Sydney, Penrith South NSW, 1797, Australia (h.marsh@uws.edu.au).

[1]  Herbert W. Marsh,et al.  Effects of Grading Leniency and Low Workload on Students' Evaluations of Teaching: Popular Myth, Bias, Validity, or Innocent Bystanders? , 2000 .

[2]  K. R. McKinnon,et al.  Benchmarking: a manual for Australian universities , 2000 .

[3]  G. Harman Vouchers or ‘student centred funding’: the 1996–1998 Australian review of higher education financing and policy , 1999 .

[4]  Elise M deWit Reflections on the Graduate Student Experience: An Overview. Anderson MS, Swazey JP (University of Minnesota; Acadia Institute, Bar Harbor, ME), The Experience of Being in Graduate School: New Direction for Higher Education. 1998;101:3-13. , 1999 .

[5]  Investigating the Relationship between Students' Attentive-Inattentive Behaviors in the Classroom and Their Literacy Progress. , 1999 .

[6]  K. Rowe,et al.  Investigating the relationship between students’ attentive–inattentive behaviors in the classroom and their literacy progress: Chapter 1 Introduction: Effects and context , 1999 .

[7]  Peter W. Hill,et al.  Modeling Educational Effectiveness in Classrooms: The Use of Multi-Level Structural Equations to Model Students’ Progress , 1998 .

[8]  K. Rowe,et al.  Modelling Student Progress in Studies of Educational Effectiveness. , 1998 .

[9]  Kenneth A. Feldman,et al.  Reflections on the Study of Effective College Teaching and Student Ratings: One Continuing Quest and Two Unresolved Issues1 , 1998 .

[10]  W. McKeachie Student ratings: The validity of use. , 1997 .

[11]  P. Abrami,et al.  Navigating student ratings of instruction. , 1997 .

[12]  H. Marsh,et al.  Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. , 1997 .

[13]  A. Greenwald,et al.  Grading leniency is a removable contaminant of student ratings. , 1997, The American psychologist.

[14]  Jaap Scheerens,et al.  The Foundations of Educational Effectiveness , 1997 .

[15]  Margot Pearson,et al.  Professionalising Ph.D. education to enhance the quality of the student experience , 1996 .

[16]  E. Holdaway Current Issues in Graduate Education. , 1996 .

[17]  Kenneth J. Rowe,et al.  Multilevel Modelling in School Effectiveness Research. , 1996 .

[18]  K. Rowe,et al.  Methodological Issues in Educational Performance and School Effectiveness Research: A Discussion with Worked Examples , 1995 .

[19]  J. Hockey Getting too close: A problem and possible solution in social science PhD supervision , 1995 .

[20]  Herbert W. Marsh,et al.  The Use of Students’ Evaluations and an Individually Structured Intervention to Enhance University Teaching Effectiveness , 1993 .

[21]  H. Marsh,et al.  Multidimensional Students' Evaluations of Teaching Effectiveness: A Profile Analysis. , 1993 .

[22]  David H. Monk,et al.  Education Productivity Research: An Update and Assessment of Its Role in Education Finance Reform , 1992 .

[23]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[24]  P. Ramsden A performance indicator of teaching quality in higher education: The Course Experience Questionnaire , 1991 .

[25]  Kathleen T. Brinko,et al.  Methodological explanations for the modest effects of feedback from student ratings. , 1990 .

[26]  P. Abrami,et al.  Validity of student ratings of instruction : what we know and what we do not , 1990 .

[27]  Kenneth A. Feldman,et al.  The association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies , 1989 .

[28]  Kenneth A. Feldman,et al.  Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers , 1989 .

[29]  P. Abrami,et al.  Students' Evaluations of University Teaching: Research Findings, Methodological Issues, and Directions for Future Research , 1987 .

[30]  H. Marsh Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[31]  Peter A. Cohen,et al.  Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings , 1980 .

[32]  John A. Centra,et al.  Determining faculty effectiveness , 1980 .

[33]  Wilbert J. McKeachie,et al.  Student Ratings of Faculty: A Reprise. , 1979 .

[34]  Michael T. Kane,et al.  The Generalizability of Student Ratings of Instruction: Estimation of the Teacher and Course Components. , 1978 .

[35]  P. Abrami The Generalizability of Student Ratings of Instruction. , 1977 .