Evaluative review in materials development

Abstract English for Academic Purposes (EAP) professionals know that initial efforts to produce or adapt materials generally require evaluative review and revision. A review process that solicits feedback from teacher and student users is critical because materials writers often find it difficult to envision the problems others may have with their materials. Despite the importance of such feedback, the EAP literature provides few insights on how to engage in evaluative review to inform material revisions. To fill this gap, we describe the evaluative review process that we developed as part of an interdisciplinary textbook development project. The case study setting is described, to situate the discussion, and includes an explanation of the scope of the project, the nature of the instructional approach, and our rationale for materials assessment. We then describe instruments developed to gather feedback from three participants groups, explain feedback-collection and data-analysis procedures, and provide sample data to demonstrate the breadth, scope, and usefulness of our evaluative review. We conclude with implications for EAP practitioners, with an emphasis on implications that are pertinent to the overall materials evaluation process and to the design of feedback-collection instruments and procedures.

[1]  James Dean Brown,et al.  The Elements of Language Curriculum: A Systematic Approach to Program Development , 1994 .

[2]  Ann M. Johns,et al.  Text, Role and Context: Developing Academic Literacies , 1997 .

[3]  J. Hedgcock,et al.  Teaching ESL composition : purpose, process, and practice , 2001 .

[4]  John M. Swales,et al.  Genre Analysis: English in Academic and Research Settings , 1993 .

[5]  K. Hyland,et al.  Disciplinary Discourses: Social Interactions in Academic Writing , 2001 .

[6]  Ulla Connor,et al.  Linguistic Analysis of Grant Proposals: European Union Research Grants , 1999 .

[7]  J. Swales Research Genres: Explorations and Applications , 2004 .

[8]  Robert Keith Johnson,et al.  The Second Language Curriculum: Index , 1989 .

[9]  John Flowerdew,et al.  Academic Listening: Research Perspectives , 1995 .

[10]  Matthew Peacock,et al.  Research Perspectives on English for Academic Purposes , 2001 .

[11]  Jack C. Richards,et al.  Curriculum Development in Language Teaching , 2001 .

[12]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[13]  James Dean Brown,et al.  Language Program Evaluation: Decisions, Problems and Solutions , 1995, Annual Review of Applied Linguistics.

[14]  James K. Jones,et al.  Demystifying Disciplinary Writing: A Case Study in the Writing of Chemistry. , 2005 .

[15]  Dana R. Ferris,et al.  ACADEMIC ORAL COMMUNICATION NEEDS OF EAP LEARNERS: WHAT SUBJECT-MATTER INSTRUCTORS ACTUALLY REQUIRE , 1996 .

[16]  Matthew Peacock,et al.  Research Perspectives on English for Academic Purposes: The EAP curriculum: Issues, methods, and challenges , 2001 .

[17]  William Grabe,et al.  Creating and validating assessment instruments for a discipline-specific writing course: an interdisciplinary approach , 2005 .

[18]  Joy Frechtling Westat The 2002 user friendly handbook for project evaluation. , 2002 .

[19]  Robert Keith Johnson,et al.  The Second Language Curriculum: A decision-making framework for the coherent language curriculum , 1989 .

[20]  Ken Hyland,et al.  Genre and second language writing , 2003 .

[21]  Ken Hyland,et al.  Second Language Writing , 2003 .

[22]  R. R. Jordan,et al.  English for Academic Purposes: A Guide and Resource Book for Teachers , 2005 .

[23]  E. Wardle,et al.  Can Cross-Disciplinary Links Help Us Teach "Academic Discourse" in FYC?. , 2004 .

[24]  M. Lecompte,et al.  Ethnography and Qualitative Design in Educational Research , 1984 .

[25]  J. Flowerdew,et al.  Second Language Listening: Theory and Practice , 2006 .

[26]  Tony Dudley-Evans,et al.  Developments in English for Specific Purposes: A Multi-Disciplinary Approach , 1998 .