Supporting Instructors to Provide Emotional and Instructional Scaffolding for English Language Learners through Biosensor-based Feedback

Delivering a presentation has been reported as one of the most anxiety-provoking tasks faced by English Language Learners. Researchers suggest that instructors should be more aware of the learners' emotional states to provide appropriate emotional and instructional scaffolding to improve their performance when presenting. Despite the critical role of instructors in perceiving the emotional states among English language learners, it can be challenging to do this solely by observing the learners? facial expressions, behaviors, and their limited verbal expressions due to language and cultural barriers. To address the ambiguity and inconsistency in interpreting the emotional states of the students, this research focuses on identifying the potential of using biosensor-based feedback of learners to support instructors. A novel approach has been adopted to classify the intensity and characteristics of public speaking anxiety and foreign language anxiety among English language learners and to provide tailored feedback to instructors while supporting teaching and learning. As part of this work, two further studies were proposed. The first study was designed to identify educators' needs for solutions providing emotional and instructional support. The second study aims to evaluate a resulting prototype as a view of instructors to offer tailored emotional and instructional scaffolding to students. The contribution of these studies includes the development of guidance in using biosensor-based feedback that will assist English language instructors in teaching and identifying the students' anxiety levels and types while delivering a presentation.

[1]  Andrea Kleinsmith,et al.  Distinguishing Anxiety Subtypes of English Language Learners Towards Augmented Emotional Clarity , 2020, AIED.

[2]  Lei Chen,et al.  Using Multimodal Cues to Analyze MLA'14 Oral Presentation Quality Corpus: Presentation Delivery and Slides Quality , 2014, MLA@ICMI.

[3]  Darren Edge,et al.  RoboCOP: A Robotic Coach for Oral Presentations , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[4]  Wen Shi,et al.  AwareMe: Addressing Fear of Public Speech through Awareness , 2016, CHI Extended Abstracts.

[5]  Stefan Scherer,et al.  Assessing Public Speaking Ability from Thin Slices of Behavior , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[6]  Mohammed E. Hoque,et al.  AutoManner: An Automated Interface for Making Public Speakers Aware of Their Mannerisms , 2016, IUI.

[7]  Alexander Travis Adams,et al.  EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions , 2016, UbiComp.

[8]  Stefan Scherer,et al.  Influence of Individual Differences when Training Public Speaking with Virtual Audiences , 2018, IVA.

[9]  T. Gregersen.  Dynamic properties of language anxiety , 2020 .

[10]  Johannes Schöning,et al.  Augmenting Social Interactions: Realtime Behavioural Feedback using Social Signal Processing Techniques , 2015, CHI.

[11]  Dolly Jesusita Young,et al.  An Investigation of Students' Perspectives on Anxiety and Speaking , 1990 .

[12]  Jean-Claude Martin,et al.  Multimodal Expressions of Stress during a Public Speaking Task: Collection, Annotation and Global Analyses , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[13]  Andrea Kleinsmith,et al.  Public Speaking Anxiety in a Real Classroom: Towards Developing a Reflection System , 2019, CHI Extended Abstracts.

[14]  Peter J. Lang,et al.  Fear reduction and fear behavior: Problems in treating a construct. , 1968 .

[15]  Graham D. Bodie,et al.  A Racing Heart, Rattling Knees, and Ruminative Thoughts: Defining, Explaining, and Treating Public Speaking Anxiety , 2010 .

[16]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[17]  Erik Stolterman,et al.  The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas , 2008, TCHI.

[18]  Robert C. Gardner,et al.  Methods and Results in the Study of Anxiety and Language Learning: A Review of the Literature* , 1991 .

[19]  Mohammed E. Hoque,et al.  ROC speak: semi-automated personalized feedback on nonverbal behavior from recorded videos , 2015, UbiComp.

[20]  Everlyne Kimani,et al.  Addressing Public Speaking Anxiety in Real-time Using a Virtual Public Speaking Coach and Physiological Sensors , 2019, IVA.

[21]  E. Horwitz,et al.  Foreign Language Classroom Anxiety , 1986 .

[22]  Chris Barker,et al.  An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience , 2002, Presence: Teleoperators & Virtual Environments.

[23]  Siriluck Usaha,et al.  A Measure of EFL Public Speaking Class Anxiety: Scale Development and Preliminary Validation and Reliability. , 2012 .

[24]  Alistair Sutherland,et al.  Multimodal system for public speaking with real time feedback: a positive computing perspective , 2016, ICMI.

[25]  James C. McCroskey,et al.  Measures of communication‐bound anxiety , 1970 .

[26]  K. J. Blom,et al.  Public speaking anxiety decreases within repeated virtual reality training sessions , 2019, PloS one.

[27]  Peter van Rosmalen,et al.  Presentation Trainer, your Public Speaking Multimodal Coach , 2015, ICMI.

[28]  Muhammad Nadeem Anwar,et al.  An Investigation of Foreign Language Classroom Anxiety and Its Relationship with Students' Achievement. , 2010 .

[29]  Torsten Wörtwein,et al.  Exploring feedback strategies to improve public speaking: an interactive virtual audience framework , 2015, UbiComp.