The effects of using mobile devices on language learning: a meta-analysis

Despite the rapid development of the field of Mobile-assisted Language Learning (MALL), research synthesis and systematic meta-analyses on MALL are still lacking. It remains unclear how effective mobile devices are for language learning under different conditions. Review studies on the overall effectiveness of the latest smart mobile devices are still scant. In order to evaluate the learning outcomes of MALL and the impact of moderator variables, we systematically searched journal articles, conference proceedings, and doctoral dissertations published during 2008–2018 and performed a meta-analysis based on a synthesis of 84 effect sizes from 80 experimental and quasi-experimental studies. A medium-to-high effect size of 0.722 was found for the overall effectiveness of using mobile devices for language learning. The findings indicate that the use of mobile devices for language learning is more effective than conventional methods. The effects of nine moderator variables were analyzed. The target language skill, target language and first/second language were found to be significant moderators. Implications for language teaching and research are discussed.

[1]  Vivian Cook,et al.  COGNITIVE PROCESSES IN SECOND LANGUAGE LEARNING , 1977 .

[2]  Suresh Renukappa,et al.  What is a smart device? - a conceptualisation within the paradigm of the internet of things , 2018 .

[3]  Hsiu-Ting Hung,et al.  Clickers in the flipped classroom: bring your own device (BYOD) to promote student learning , 2017, Interact. Learn. Environ..

[4]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[5]  Arthur Lai,et al.  Mobile immersion: an experiment using mobile instant messenger to support second-language learning , 2016, Interact. Learn. Environ..

[6]  Patricia Thornton,et al.  Using mobile phones in English education in Japan , 2005, J. Comput. Assist. Learn..

[7]  S. Binks.  Testing enhances learning: A review of the literature. , 2017, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[8]  Robert Godwin-Jones,et al.  Smartphones and language learning , 2017 .

[9]  R. Orwin.  A fail-safe N for effect size in meta-analysis. , 1983 .

[10]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[11]  Chih-Ming Chen,et al.  Personalized mobile English vocabulary learning system based on item response theory and learning memory cycle , 2008, Comput. Educ..

[12]  J. Rubin.  WHAT THE GOOD LANGUAGE LEARNER CAN TEACH US , 1975 .

[13]  Robert Fox,et al.  Using PDA for undergraduate student incidental vocabulary testing , 2008, ReCALL.

[14]  Jack Burston,et al.  MALL: the pedagogical challenges , 2014 .

[15]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[16]  SungYao-Ting,et al.  The effects of integrating mobile devices with teaching and learning on students' learning performance , 2016 .

[17]  Huifen Lin,et al.  Mobile-assisted ESL/EFL vocabulary learning: a systematic review and meta-analysis , 2019, Computer Assisted Language Learning.

[18]  Lesley Shield,et al.  An overview of mobile assisted language learning: From content delivery to supported collaboration and interaction , 2008, ReCALL.

[19]  Jun Scott Chen Hsieh,et al.  Using the flipped classroom to enhance EFL learning , 2017 .

[20]  Jack Burston,et al.  Twenty years of MALL project implementation: A meta-analysis of learning outcomes , 2014, ReCALL.

[21]  Walcir Cardoso,et al.  Activate space rats! Fluency development in a mobile game-assisted environment , 2018 .

[22]  Gwo-Jen Hwang,et al.  Trends in the research design and application of mobile language learning: a review of 2007–2016 publications in selected SSCI journals , 2018, Interact. Learn. Environ..

[23]  L. V. Lier.  The Ecology and Semiotics of Language Learning: A Sociocultural Perspective , 2004 .

[24]  Minoo Alemi,et al.  Successful Learning of Academic Word List via MALL: Mobile Assisted Language Learning. , 2012 .

[25]  Tzu-Chien Liu,et al.  The effects of integrating mobile devices with teaching and learning on students' learning performance: A meta-analysis and research synthesis , 2016, Comput. Educ..

[26]  R. Rosenthal.  The file drawer problem and tolerance for null results , 1979 .

[27]  Walcir Cardoso,et al.  The pedagogical use of mobile speech synthesis (TTS): focus on French liaison , 2017 .

[28]  Kursat Cagiltay,et al.  Mobile Language Learning Contribution of Multimedia Messages via Mobile Phones in Consolidating Vocabulary , 2012 .

[29]  Jacobijn Sandberg,et al.  Mobile English learning: An evidence-based study with fifth graders , 2011, Comput. Educ..

[30]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[31]  Chi-Cheng Chang,et al.  Outdoor ubiquitous learning or indoor CAL? Achievement and different cognitive loads of college students , 2018, Behav. Inf. Technol..

[32]  Carol A. Chapelle,et al.  A meta-analysis of effectiveness studies on computer technology-supported language learning , 2013, ReCALL.

[33]  María José de la Fuente,et al.  Learners' attention to input during focus on form listening tasks: the role of mobile technology in the second language classroom , 2014 .

[34]  Hassan Saleh Mahdi.  Effectiveness of Mobile Devices on Vocabulary Learning: A Meta-Analysis , 2018 .

[35]  D. Zheng,et al.  Dialogicality, Ecology, and Learning in Online Game Worlds , 2017 .

[36]  Chih-cheng Lin,et al.  Learning English with electronic textbooks on tablet PCs , 2017, Interact. Learn. Environ..

[37]  K. Dickersin,et al.  Publication bias in clinical trials , 2007 .

[38]  Alberto Andújar Vaca,et al.  Mobile Instant Messaging: Whatsapp and its Potential to Develop Oral Skills , 2019 .

[39]  Jack Burston,et al.  The Reality of MALL: Still on the Fringes , 2014 .

[40]  Wu-Yuin Hwang,et al.  Users’ familiar situational contexts facilitate the practice of EFL in elementary schools with mobile devices , 2013 .

[41]  Agnes Kukulska-Hulme,et al.  Will mobile learning change language learning? , 2009, ReCALL.

[42]  Miguel Nussbaum,et al.  Computer supported collaborative learning using wirelessly interconnected handheld computers , 2004, Comput. Educ..

[43]  Chu-Sing Yang,et al.  Ubiquitous English Learning System with Dynamic Personalized Guidance of Learning Portfolio , 2011, J. Educ. Technol. Soc..

[44]  Kuo-En Chang,et al.  How effective are mobile devices for language learning? A meta-analysis , 2015 .

[45]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[46]  Yen-Ting Lin,et al.  Mobile Seamless Technology Enhanced CSL Oral Communication , 2016, J. Educ. Technol. Soc..

[47]  Leo Van Lier,et al.  The Ecology and Semiotics of Language Learning , 2004 .

[48]  Gwo-Jen Hwang,et al.  A Learning Analytics Approach to Investigating Factors Affecting EFL Students' Oral Performance in a Flipped Classroom , 2018, J. Educ. Technol. Soc..

[49]  Marcelo Milrad,et al.  Mobile learning: small devices, big issues , 2009 .

[50]  Mehmet Asmalı.  Integrating Technology into ESP Classes: Use of Student Response System in English for Specific Purposes Instruction. , 2018 .

[51]  Alaba Olaoluwakotansibe Agbatogun,et al.  Developing Learners' Second Language Communicative Competence through Active Learning: Clickers or Communicative Approach? , 2014, J. Educ. Technol. Soc..

[52]  Rod Ellis,et al.  The Study of Second Language Acquisition , 1994 .

[53]  Alberto Andújar-Vaca,et al.  Mobile Instant Messaging: Whatsapp and Its Potential to Develop Oral Skills. , 2017 .

[54]  Robert Godwin-Jones.  Augmented reality and language learning: From annotated vocabulary to place-based mobile games , 2016 .

[55]  Wen-Chi Vivian Wu,et al.  Creating an Online Learning Community in a Flipped Classroom to Enhance EFL Learners. Oral Proficiency , 2017, J. Educ. Technol. Soc..

[56]  Y.-H. Wang,et al.  Could a mobile-assisted learning system support flipped classrooms for classical Chinese learning? , 2016, J. Comput. Assist. Learn..

[57]  Tsung-Yu Liu,et al.  Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation , 2010, Comput. Educ..

[58]  Y. Liu,et al.  An ecological community becoming: Language learning as first-order experiencing with place and mobile technologies , 2017 .

[59]  K. Dickersin,et al.  Publication bias and clinical trials. , 1987, Controlled clinical trials.

[60]  Sungwoong Lee,et al.  The Effects of Using Mobile Devices on Student Achievement in Language Learning: A Meta-Analysis , 2018, Education Sciences.

[61]  Alberto Andujar,et al.  Benefits of mobile instant messaging to develop ESL writing , 2016 .

[62]  Qun Wu,et al.  Designing a smartphone app to teach English (L2) vocabulary , 2015, Comput. Educ..

[63]  Lanqin Zheng,et al.  Effects of a mobile self-regulated learning approach on students’ learning achievements and self-regulated learning skills , 2016 .

[64]  Mike Levy,et al.  Learning Italian via mobile SMS , 2005 .

[65]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[66]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[67]  Niall Winters,et al.  What is mobile learning , 2006 .

[68]  Chi-Cheng Chang,et al.  BYOD or not: A comparison of two assessment strategies for student learning , 2017, Comput. Hum. Behav..

[69]  Lara Lomicka,et al.  Going Mobile: Language Learning With an iPod Touch in Intermediate French and German Classes , 2013 .

[70]  Jan Herrington,et al.  Design principles for mobile learning , 2009 .

[71]  Mike Sharples,et al.  Towards a Theory of Mobile Learning , 2005 .

[72]  Marina Minhui Lu.  Effectiveness of vocabulary learning via mobile phone , 2008, J. Comput. Assist. Learn..

[73]  Gwo-Jen Hwang,et al.  Research trends in mobile and ubiquitous learning: a review of publications in selected journals from 2001 to 2010 , 2011, Br. J. Educ. Technol..

[74]  Liang-Yi Li,et al.  Construction of cognitive maps to improve e-book reading and navigation , 2013, Comput. Educ..

[75]  Nuray Gedik,et al.  Research trends in mobile assisted language learning from 2000 to 2012 , 2014, ReCALL.

[76]  Wu-Yuin Hwang,et al.  A Study of the Use of Wearable Devices for Healthy and Enjoyable English as a Foreign Language Learning in Authentic Contexts , 2018, J. Educ. Technol. Soc..

[77]  Wu-Yuin Hwang,et al.  Improving English as a foreign language writing in elementary schools using mobile devices in familiar situational contexts , 2014 .

[78]  Vivian Cook,et al.  THE COMPARISON OF LANGUAGE DEVELOPMENT IN NATIVE CHILDREN AND FOREIGN ADULTS , 1973 .