Computer-mediated glosses in second language reading comprehension and vocabulary learning: A meta-analysis

Language learners have unprecedented opportunities for developing second language literacy skills and intercultural understanding by reading authentic texts on the Internet and in multimedia computer-assisted language learning environments. This article presents findings from a meta-analysis of 11 studies of computer-mediated glosses in second language reading comprehension and incidental vocabulary learning. Computer-mediated glosses had an overall medium effect on second language reading comprehension and a large effect on incidental vocabulary learning. Mean effect sizes varied from medium to large depending upon the level of instruction, text type, and assessment tasks. Drawing upon findings of this meta-analysis and the overall characteristics of gloss studies, we propose recommendations for future research, including replications and the systematic study of reading variables and learner individual differences in multimedia learning environments with authentic texts.

[1]  Marlise Horst,et al.  EXPANDING ACADEMIC VOCABULARY WITH AN INTERACTIVE ON-LINE DATABASE , 2005 .

[2]  Susanne Rott.  THE EFFECT OF EXPOSURE FREQUENCY ON INTERMEDIATE LANGUAGE LEARNERS' INCIDENTAL VOCABULARY ACQUISITION AND RETENTION THROUGH READING , 1999, Studies in Second Language Acquisition.

[3]  Julia Stakhnevich,et al.  Reading on the Web: Implications for ESL Professionals. , 2002 .

[4]  Huizhong Shen,et al.  Integration of computers into an EFL reading classroom , 2006, ReCALL.

[5]  Vilson J. Leffa,et al.  Making foreign language texts comprehensible for beginners: An experiment with an electronic glossary , 1992 .

[6]  Michael H. Long,et al.  THE EFFECTS OF SIMPLIFIED AND ELABORATED TEXTS ON FOREIGN LANGUAGE READING COMPREHENSION , 1994 .

[7]  James N. Davis,et al.  Computers and L2 Reading: Student Performance, Student Attitudes , 1997 .

[8]  Min Liu.  Contextual enrichment through hypermedia technology: implications for second-language learning , 1995 .

[9]  Mike Levy,et al.  Worldcall : global perspectives on computer-assisted language learning , 1999 .

[10]  Hossein Nassaji,et al.  L2 Vocabulary Learning From Context: Strategies, Knowledge Sources, and Their Relationship With Success in L2 Lexical Inferencing , 2003 .

[11]  Ofelia R. Nikolova.  Effects of Students' Participation in Authoring of Multimedia Materials on Student Acquisition of Vocabulary. , 2002 .

[12]  Paul F. Merrill,et al.  Second language vocabulary acquisition using a diglot reader or a computer-based drill and practice program , 2007 .

[13]  María del Pilar,et al.  Investigating tasks in formal language learning , 2007 .

[14]  Caroline A. Grace.  Gender Differences: Vocabulary Retention and Access to Translations for Beginning Language Learners in CALL , 2000 .

[15]  Shira Koren,et al.  Vocabulary Instruction through Hypertext: Are There Advantages over Conventional Methods of Teaching?. , 1999 .

[16]  D. J. Young.  Linguistic Simplification of SL Reading Material: Effective Instructional Practice? , 1999 .

[17]  Robert Ariew.  A TEMPLATE TO GENERATE HYPERTEXT AND HYPERMEDIA READING MATERIALS: ITS DESIGN AND ASSOCIATED RESEARCH FINDINGS , 2006 .

[18]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[19]  Yukie Horiba,et al.  Reader Control in Reading: Effects of Language Competence, Text Type, and Task , 2000 .

[20]  Batia Laufer,et al.  What Lexical Information Do L2 Learners Select in a CALL Dictionary and How Does It Affect Word Retention , 2000 .

[21]  Batia Laufer,et al.  Understanding Unfamiliar Words in a Text: Do L2 Learners Understand How Much They Don't Understand?. , 2001 .

[22]  K. Kondo-Brown.  How Do English L1 Learners of Advanced Japanese Infer Unknown Kanji Words in Authentic Texts , 2006 .

[23]  Juan Carlos Espinosa,et al.  Comprehensive Meta-Analysis , 2004 .

[24]  Batia Laufer,et al.  The Relationship Between Passive and Active Vocabularies: Effects of LanguageLearning Context , 1998 .

[25]  S. Knight.  Dictionary Use While Reading: The Effects On Comprehension and Vocabulary Acquisition For Students Of Different Verbal Abilities , 1994 .

[26]  Elizabeth B. Bernhardt.  PROGRESS AND PROCRASTINATION IN SECOND LANGUAGE READING , 2005, Annual Review of Applied Linguistics.

[27]  Salem Issa Aweiss.  Situating Learning in Technology: The Case of Computer-Mediated Reading Supports , 1994 .

[28]  U Felix.  ANALYZING RECENT CALL EFFECTIVENESS RESEARCH: TOWARD A COMMON AGENDA , 2005 .

[29]  Adina Levine,et al.  Comparing Dictionary Definitions and Glosses in Hypertext Foreign Language Reading: Facilitating Foreign Language Reading Comprehension and Vocabulary Acquisition , 2004 .

[30]  R. Hanka.  The Handbook of Research Synthesis , 1994 .

[31]  Noriko Nagata,et al.  THE EFFECTIVENESS OF COMPUTER-ASSISTED INTERACTIVE GLOSSES , 1999 .

[32]  B. Laufer.  Second Language Vocabulary Acquisition: The lexical plight in second language reading: Words you don't know, words you think you know, and words you can't guess , 1996 .

[33]  S. Webb.  The Effects of Repetition on Vocabulary Knowledge , 2007 .

[34]  Neil Heffernan,et al.  The Short Readings Project: A CALL reading activity utilizing vocabulary recycling , 2006 .

[35]  Ana Frankenberg-Garcia,et al.  A Peek into What Today's Language Learners as Researchers Actually Do , 2005 .

[36]  James Coady,et al.  第二語言詞彙習得=Second language vocabulary acquisition : a rationale for pedagogy /James Coady, Thomas Huckin編 , 1996 .

[37]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[38]  Bonnie L. Earnest Youngs.  CALL and second language acquisition: The use of the "Reader" computer program to improve student proficiency in French , 1994 .

[39]  M. Yoshii.  L1 and L2 Glosses: Their Effects on Incidental Vocabulary Learning , 2006 .

[40]  M. Lyman-Hager,et al.  The Case for Computer-Mediated Reading: "Une vie de boy.". , 1996 .

[41]  Jean W. LeLoup,et al.  Vocabulary support for independent online reading , 2005 .

[42]  Isabelle De Ridder,et al.  Visible or Invisible Links: Does the Highlighting of Hyperlinks Affect Incidental Vocabulary Learning, Text Comprehension, and the Reading Process? , 2002 .

[43]  Melissa A. Bowles.  L2 glossing: To CALL or not to CALL , 2004 .

[44]  Philip L. Hubbard,et al.  A review of subject characteristics in CALL research , 2005 .

[45]  Min Liu,et al.  A Look at the Research on Computer-Based Technology Use in Second Language Learning , 2002 .

[46]  Chiho Kobayashi,et al.  The use of pocket electronic dictionaries as compared with printed dictionaries by Japanese learners of English , 2006 .

[47]  Gülcan Erçetin,et al.  Exploring the Potential of Hypermedia Annotations for Second Language Reading , 2003 .

[48]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[49]  Ofelia R. Nikolova,et al.  The Impact of a Language Learning Task on Instructional Outcomes in Two Student Populations: High-Ability and Average-Ability Students , 2003 .

[50]  Fleming Louis Bell,et al.  Comprehension AIDS, Internet Technologies, and the Reading of Authentic Materials by Adult Second Language Learners , 2005 .

[51]  B. Brennan.  Insights into Second Language Reading: A Cross-Linguistic Approach , 2006 .

[52]  Robert A. Fischer.  How do we Know what Students are Actually Doing? Monitoring Students' Behavior in CALL , 2007 .

[53]  Diana Frantzen.  Factors Affecting How Second Language Spanish Students Derive Meaning from Context , 2003 .

[54]  Aimet Coriano Velazquez.  Vocabulary acquisition through reading: A study of the effectiveness of different CALL -based annotations , 2001 .

[55]  Klaus Brandl,et al.  INTEGRATING INTERNET-BASED READING MATERIALS INTO THE FOREIGN LANGUAGE CURRICULUM : FROM TEACHER-TO STUDENT-CENTERED APPROACHES , 2002 .

[56]  J. Hulstijn.  When Do Foreign‐Language Readers Look Up the Meaning of Unfamiliar Words? The Influence of Task and Learner Variables , 1993 .

[57]  Ofelia R. Nikolova.  Effects of Visible and Invisible Hyperlinks on Vocabulary Acquisition and Reading Comprehension for High- and Average-Foreign Language Achievers , 2004 .

[58]  Lorens A. Imhof,et al.  Computer‐Assisted Reading: The Effect of Glossing Format on Comprehension and Vocabulary Retention , 2001 .

[59]  Dorothy M. Chun,et al.  Facilitating reading comprehension with multimedia , 1996 .

[60]  Lies Sercu,et al.  The effect of task complexity and task conditions on foreign language development and performance. Three empirical studies , 2006 .

[61]  Joan-Tomás Pujolă,et al.  CALLing for help: researching language learning strategies using help facilities in a web-based multimedia program , 2002, ReCALL.

[62]  J. Hulstijn,et al.  SOME EMPIRICAL EVIDENCE FOR THE INVOLVEMENT LOAD HYPOTHESIS IN VOCABULARY ACQUISITION , 2001 .

[63]  Hossein Nassaji.  The Relationship between Depth of Vocabulary Knowledge and L2 Learners' Lexical Inferencing Strategy Use and Success , 2004 .

[64]  Denise E. Murray,et al.  Scaffolding instruction for reading the Web , 2006 .

[65]  S. Gass.  Second Language Vocabulary Acquisition , 1988, Annual Review of Applied Linguistics.

[66]  Wei Hong,et al.  Multimedia Computer‐Assisted Reading in Business Chinese , 1997 .

[67]  Batia Laufer,et al.  Vocabulary in a Second Language: Selection, Acquisition and Testing , 2004 .

[68]  Dorte Albrechtsen.  Perspectives on foreign and second language pedagogy : essays presented to Kirsten Haastrup on the occasion of her sixtieth birtday , 1998 .

[69]  Suzanne Q. Hoffman.  The effect of hypertext environment on the reading comprehension of second language learners in an intermediate-level college German course , 1998 .

[70]  Dorothy M. Chun,et al.  What Makes Students Click: Working Memory and Look-Up Behavior , 2004 .

[71]  Marjorie Bingham Wesche,et al.  Second Language Vocabulary Acquisition: Vocabulary enhancement activities and reading for meaning in second language vocabulary acquisition , 1996 .

[72]  Elizabeth J. Pretorius.  The comprehension of logical relations in expository texts by students who study through the medium of ESL , 2006 .

[73]  Asim Sakar,et al.  Effectiveness of hypermedia annotations for foreign language reading , 2005, J. Comput. Assist. Learn..

[74]  Hsien-Chin Liou,et al.  The Electronic Bilingual Dictionary as a Reading Aid to EFL Learners: Research Findings and Implications , 2000 .

[75]  Elyes Ben Salem.  The influence of electronic glosses on word retention and reading comprehension with Spanish language learners , 2007 .

[76]  Lina Lopez Chiappone,et al.  A comparative study of English language learners reading storybooks in traditional print and digital formats , 2003 .

[77]  Osamu Takeuchi,et al.  Does Look-up Frequency Help Reading Comprehension of EFL Learners? Two Empirical Studies of Electronic Dictionaries , 2007, CALICO Journal.

[78]  Susan L. Cooledge.  L2 reading and hypertext: A study of lexical glosses and comprehension among intermediate learners of French , 2004 .

[79]  T. Sima Paribakht,et al.  L2 Reading Proficiency and Lexical Inferencing by University EFL Learners , 2004 .

[80]  Jan L. Plass,et al.  The Cambridge Handbook of Multimedia Learning: Multimedia Learning in Second Language Acquisition , 2005 .

[81]  Lee B. Abraham.  Second language reading comprehension and vocabulary learning with multimedia , 2007 .

[82]  D. Pulido,et al.  The Effects of Topic Familiarity and Passage Sight Vocabulary on L2 Lexical Inferencing and Retention through Reading , 2007 .

[83]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[84]  Detlev Leutner,et al.  Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities , 2003, Comput. Hum. Behav..

[85]  W. Roby.  WHAT'S IN A GLOSS? , 1999 .

[86]  Piet Swanepoel,et al.  Theoretical and Methodological Pluralism in Designing Effective Lexical Support for CALL , 2003 .

[87]  Uschi Felix,et al.  What do meta-analyses tell us about CALL effectiveness? , 2005, ReCALL.

[88]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[89]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[90]  D. Pulido,et al.  Modeling the Role of Second Language Proficiency and Topic Familiarity in Second Language Incidental Vocabulary Acquisition Through Reading , 2003 .

[91]  R. Orwin.  A fail-safe N for effect size in meta-analysis. , 1983 .

[92]  John Paul Loucky.  Combining the benefits of electronic and online dictionaries with CALL web sites to produce effective and enjoyable vocabulary and language learning lessons , 2005 .

[93]  Dorothy M. Chun.  L2 Reading on the Web: Strategies for Accessing Information in Hypermedia , 2001 .

[94]  Davida Charney,et al.  Cultural Representations of Rhetorical Conventions: The Effects on Reading Recall. , 2002 .

[95]  郭金红,et al.  材料的真实性及真实性与外语学习的关系—— Authentic Materials and Authenticity in Foreign Language Learning的评介 , 2010 .

[96]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[97]  Jeong-Bae Son.  A Hypertext Approach to Foreign Language Reading: Student Attitudes and Perceptions , 2003 .

[98]  Louise Elizabeth Stoehr,et al.  The effects of built-in comprehension aids in a CALL program on student-readers' understanding of a foreign language literary text , 2000 .

[99]  R. Rosenthal.  The file drawer problem and tolerance for null results , 1979 .

[100]  A. Gilmore.  Authentic materials and authenticity in foreign language learning , 2007, Language Teaching.

[101]  F. L. Bell,et al.  The Language of Glosses in L2 Reading on Computer: Learners' Preferences , 2000 .

[102]  Elke Peters,et al.  L2 vocabulary acquisition and reading comprehension: the influence of task complexity , 2006 .

[103]  Dorothy M. Chun,et al.  Effects of Multimedia Annotations on Vocabulary Acquisition , 1996 .

[104]  Dorothy M. Chun,et al.  RESEARCH ON TEXT COMPREHENSION IN MULTIMEDIA ENVIRONMENTS , 1997 .

[105]  Isabelle De Ridder.  Are We Conditioned to Follow Links? Highlights in CALL Materials and Their Impact on the Reading Process , 2000 .

[106]  Elke Peters,et al.  MANIPULATING L2 LEARNERS' ONLINE DICTIONARY USE AND ITS EFFECT ON L2 WORD RETENTION , 2007 .

[107]  Lourdes Ortega,et al.  Synthesizing research on language learning and teaching , 2006 .

[108]  Robert J. Blake,et al.  Second-Language Reading on the Computer , 1992 .

[109]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[110]  Klaus Brandl,et al.  The Integration of Internet-Based Reading Materials into the Foreign Language Curriculum: From Teacher- to Student-Centered Approaches , 2002 .

[111]  Caroline A. Grace.  Retention of Word Meanings Inferred from Context and Sentence‐Level Translations: Implications for the Design of Beginning‐Level CALL Software , 1998 .

[112]  Khalid Al-Seghayer,et al.  THE EFFECT OF MULTIMEDIA ANNOTATION MODES ON L2 VOCABULARY ACQUISITION: A COMPARATIVE STUDY , 2001 .

[113]  Cindy Brantmeier,et al.  Effects of Reader's Knowledge, Text Type, and Test Type on L1 and L2 Reading Comprehension in Spanish , 2005 .

[114]  Julia Vanloan Aguilar.  How can multimedia be designed to assist comprehension of the literary text for foreign language learners , 1996 .

[115]  Hugh Bishop.  The effect of typographic salience on the look up and comprehension of unknown formulaic sequences , 2004 .

[116]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[117]  Ofelia R. Nikolova,et al.  Influence of gender and academic ability in a computer‐based Spanish reading task , 2004 .

[118]  B. Laufer,et al.  Type of task, time-on-task and electronic dictionaries in incidental vocabulary acquisition , 2003 .

[119]  Tommy B. McDonell.  Reading plain text and hypertext on the Internet for native and non-native speakers of English , 2006 .

[120]  Min Liu,et al.  The Effect of Hypermedia Assisted Instruction on Second Language Learning , 1993 .

[121]  Dorothy M. Chun,et al.  SUPPORTING VISUAL AND VERBAL LEARNING PREFERENCES IN A SECOND LANGUAGE MULTIMEDIA LEARNING ENVIRONMENT , 1998 .

[122]  C. Lai,et al.  CALLING ON CALL: FROM THEORY AND RESEARCH TO NEW DIRECTIONS IN FOREIGN LANGUAGE TEACHING , 2008, Studies in Second Language Acquisition.

[123]  J. Hulstijn.  Intentional and incidental second-language vocabulary learning: A reappraisal of elaboration, rehearsal and automaticity , 2001 .

[124]  Ronald Aust,et al.  The use of hyper-reference and conventional dictionaries , 1993 .

[125]  Dana L. Grisham,et al.  Scaffolding English Language Learners and Struggling Readers in a Universal Literacy Environment with Embedded Strategy Instruction and Vocabulary Support , 2007 .

[126]  François Pichette,et al.  Time Spent on Reading and Reading Comprehension in Second Language Learning , 2005 .

[127]  Peter Robinson,et al.  Cognition and Second Language Instruction: COGNITION AND INSTRUCTION , 2001 .

[128]  Jan H. Hulstijn,et al.  Incidental learning of second language vocabulary in computer-assisted reading and writing tasks , 1998 .

[129]  Lara Lomicka,et al.  TO GLOSS OR NOT TO GLOSS: AN INVESTIGATION OF READING COMPREHENSION ONLINE , 1998 .

[130]  W. Dunlap,et al.  Meta-Analysis of Experiments With Matched Groups or Repeated Measures Designs , 1996 .

[131]  Volker Heinz Hegelheimer.  Effects of textual glosses and sentence-level audio glosses on on-line reading comprehension and vocabulary recall , 1998 .

[132]  Batia Laufer,et al.  Electronic dictionaries and incidental vocabulary acquisition: does technology make a difference? , 2000 .

[133]  Warren Brent Roby.  Glosses and dictionaries in paper and computer formats as adjunct aids to the reading of spanish texts by university students , 1991 .