Effectiveness of a digital pen-based learning system with a reward mechanism to improve learners’ metacognitive strategies in listening

Abstract A number of prominent educators have confirmed that developing learners’ metacognitive strategies about listening is an important way of helping them learn how to listen to improve their listening. With the rapid development of information and communication technologies, many listening training systems provide various types of help options in support of listening comprehension. However, learners may be unaware of how effectively use these help options or they may rely too heavily on them, thus reducing the effectiveness of their listening practice. Therefore, this study develops a digital pen-based learning system with a reward mechanism that guides learners through the metacognitive processes effectively use available help options to develop listening skills. Two experiments were performed to evaluate the effects of the proposed system on learners’ listening achievement, motivation, and metacognitive awareness. The experimental results indicated that the proposed system improved learners’ listening comprehension, learning motivation, and metacognitive awareness. A lag-sequential analysis was conducted to infer learners’ behavioral patterns to explore how learners used the help options to perform listening tasks. Several interesting behavioral patterns were found and discussed.

[1]  Shao-Chen Chang,et al.  Effects of integrating an active learning-promoting mechanism into location-based real-world learning environments on students’ learning performances and behaviors , 2017, Educational Technology Research and Development.

[2]  Mohammed Ali Mohsen.  The use of help options in multimedia listening environments to aid language learning: A review , 2016, Br. J. Educ. Technol..

[3]  Mu-Hsuan Chou.  A Task-based Language Teaching Approach to Developing Metacognitive Strategies for Listening Comprehension , 2017 .

[4]  April Ginther,et al.  Context and content visuals and performance on listening comprehension stimuli , 2002 .

[5]  Roger Bakeman,et al.  Observer agreement for timed-event sequential data: A comparison of time-based and event-based algorithms , 2009, Behavior research methods.

[6]  Paul Gruba,et al.  Listeners' interactions with help options in CALL , 2014 .

[7]  Kara McBride,et al.  The effect of rate of speech and distributed practice on the development of listening comprehension , 2011 .

[8]  Michael Yeldham,et al.  Techniques for researching L2 listeners , 2017 .

[9]  Shelley Shwu-Ching Young,et al.  No student left behind: a collaborative and competitive game-based learning environment to reduce the achievement gap of EFL students in Taiwan , 2015 .

[10]  C. Goh,et al.  Exploring the relationship between metacognitive awareness and listening performance with questionnaire data , 2014 .

[11]  Abdullah Sarani,et al.  The Effect of Video-Based Tasks in Listening Comprehension of , 2014 .

[12]  J. Treffers-Daller,et al.  Explaining listening comprehension among L2 learners of English: the contribution of general language proficiency, vocabulary knowledge and metacognitive awareness , 2017 .

[13]  Gwo-Jen Hwang,et al.  Interaction of problem-based gaming and learning anxiety in language students' English listening performance and progressive behavioral patterns , 2017, Comput. Educ..

[14]  Dawn Bikowski,et al.  Developing collaborative autonomous learning abilities in computer mediated language learning: attention to meaning among students in wiki space , 2010 .

[15]  Larry Vandergrift,et al.  Relationships among Motivation Orientations, Metacognitive Awareness and Proficiency in L2 Listening. , 2005 .

[16]  Suzanne Graham,et al.  Listening comprehension: The learners’ perspective , 2006 .

[17]  Abdolmajid Hayati,et al.  The Effect of Speech Rate on Listening Comprehension of EFL learners , 2010 .

[18]  Joan-Tomás Pujolă,et al.  CALLing for help: researching language learning strategies using help facilities in a web-based multimedia program , 2002, ReCALL.

[19]  Chih-Kai Chang.  Augmenting Wiki System for Collaborative EFL Reading by Digital Pen Annotations , 2009, 2009 International Symposium on Ubiquitous Virtual Reality.

[20]  David Frohlich,et al.  PaperClip: A Digital Pen Interface for Semantic Speech Editing in Radio Production , 2018 .

[21]  Yong Zhao.  The Effects of Listeners' Control of Speech Rate on Second Language Comprehension , 1997 .

[22]  Chih-Ming Chen,et al.  Facilitating English-language learners' oral reading fluency with digital pen technology , 2016, Interact. Learn. Environ..

[23]  Volker Hegelheimer,et al.  Help Options and Multimedia Listening: Students' Use of Subtitles and the Transcript , 2007 .

[24]  C. Goh,et al.  The Metacognitive Awareness Listening Questionnaire: Development and Validation , 2006 .

[25]  Jie-Chi Yang,et al.  Captions and reduced forms instruction: The impact on EFL students’ listening comprehension , 2013, ReCALL.

[26]  Larry Vandergrift,et al.  Teaching L2 Learners How to Listen Does Make a Difference: An Empirical Study , 2010 .

[27]  Patricia Dunkel,et al.  Listening in the Native and Second/Foreign Language: Toward an Integration of Research and Practice , 1991 .

[28]  C. Goh.  A cognitive perspective on language learners' listening comprehension problems , 2000 .

[29]  Robert Vanderplank,et al.  Déjà vu? A decade of research on language laboratories, television and video in language learning , 2009, Language Teaching.

[30]  Jeremy Cross.  Help options for L2 listening in CALL: A research agenda , 2017, Language Teaching.

[31]  Chih-Ming Chen,et al.  Using a Paper-based Digital Pen for Supporting English Courses in Regular Classrooms to Improve Reading Fluency , 2013, Int. J. Humanit. Arts Comput..

[32]  C. Goh,et al.  Metacognitive Instruction for Second Language Listening Development , 2008 .

[33]  David Coniam,et al.  The use of audio or video comprehension as an assessment instrument in the certification of English language teachers: a case study , 2001 .

[34]  Ming-Kuan Tsai,et al.  Applying Speech Techniques to Practice Listening and Speaking Skills for EFL Learners: An Exploratory Study , 2010, 2010 Third IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[35]  Jeremy Cross,et al.  Effects of listening strategy instruction on news videotext comprehension , 2009 .

[36]  Volker Hegelheimer,et al.  Using CALL in the classroom: Analyzing student interactions in an authentic classroom , 2004 .

[37]  Gwo-Jen Hwang,et al.  Mobile-based collaborative learning in the fitness center: A case study on the development of English listening comprehension with a context-aware application , 2018, Br. J. Educ. Technol..

[38]  Gary J. Ockey,et al.  Construct implications of including still image or video in computer-based listening tests , 2007 .

[39]  Yao-Ting Sung,et al.  A mobile-device-supported peer-assisted learning system for collaborative early EFL reading , 2007 .

[40]  H. Walberg,et al.  What Influences Learning? A Content Analysis of Review Literature , 1990 .

[41]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[42]  M. Yeldham,et al.  Toward an instructional approach to developing interactive second language listening , 2014 .

[43]  Paul Gruba,et al.  Help Options in CALL: A Systematic Review , 2009 .

[44]  Rouhollah Rahmatian,et al.  The Effectiveness of Audio and Video Documents in Developing Listening Comprehension Skill in a Foreign Language , 2011 .

[45]  Larry Vandergrift.  From Prediction Through Reflection: Guiding Students: Through the Process of L2 Listening , 2003 .

[46]  S. Baleghizadeh,et al.  The Relationship among Listening Performance, Metacognitive Strategy Use and Motivation from a Self-determination Theory Perspective , 2011 .

[47]  Hussein M. Elkhafaifi.  The Effect of Prelistening Activities on Listening Comprehension in Arabic Learners , 2005 .

[48]  Larry Vandergrift.  Recent developments in second and foreign language listening comprehension research , 2007, Language Teaching.

[49]  Dolores Ramírez Verdugo,et al.  Using Digital Stories to Improve Listening Comprehension with Spanish Young Learners of English. , 2007 .

[50]  Hayo Reinders,et al.  Can I Say Something? The Effects of Digital Game Play on Willingness to Communicate. , 2014 .

[51]  C. Goh,et al.  Metacognitive Instruction in Listening for Young Learners. , 2006 .

[52]  Roger Bakeman,et al.  Observer agreement for event sequences: Methods and software for sequence alignment and reliability estimates , 2007, Behavior research methods.

[53]  Ernesto Macaro,et al.  Strategy Instruction in Listening for Lower‐Intermediate Learners of French , 2008 .

[54]  Eleanor L. Higgins,et al.  The Compensatory Effectiveness of the Quicktionary Reading Pen II on the Reading Comprehension of Students with Learning Disabilities , 2004 .

[55]  Yao-Ting Sung,et al.  Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum , 2014, Comput. Educ..

[56]  Po-Yao Chao,et al.  The Interactive Multimedia Textbook: Using A Digital Pen to Support Learning for Computer Programming , 2007, Seventh IEEE International Conference on Advanced Learning Technologies (ICALT 2007).

[57]  R. Clément,et al.  Why Are You Learning a Second Language? Motivational Orientations and Self‐Determination Theory , 2000 .