Exploring Preservice Teachers’ Emotional Experiences in an Immersive Virtual Teaching Simulation through Facial Expression Recognition

ABSTRACT This study investigated preservice teachers’ emotional experiences while interacting within a virtual scenario-based teacher-training system called Simulation for Teaching Enhancement of Authentic Classroom beHavior Emulator (SimTEACHER). We created three types of interactions (no interaction, unexpected interaction, and expected interaction) within SimTEACHER and examined the influences of the interaction design on preservice teachers’ emotional responses in three aspects: key performance indicators (attention, emotional engagement, and sentiment), emotional valence (positive, neutral, and negative), and four basic emotions (joy, sadness, fear, and anger). Fourteen preservice teachers from a 4-year public university in southwestern South Korea participated in this study. The data of the participants’ emotional expressions were collected using the Emotient software, which has been widely used for automated facial expression recognition and analysis. A series of one-way repeated-measured Analysis of Variance (ANOVA) indicated that participants experienced higher positive and neutral emotions, higher emotional engagement, and a higher feeling of joy when they engaged in unexpected interactions than when they engaged in expected interactions or no interactions.

[1]  Marshall H. Raskind,et al.  Virtual Technology , 2005 .

[2]  A. Fluck,et al.  Pre-service teachers’ perceptions of simSchool as preparation for inclusive education: a pilot study , 2014 .

[3]  K. Tsang.  Emotional labor of teaching , 2011 .

[4]  Barney Dalgarno,et al.  VirtualPREX: Innovative assessment using a 3D virtual world with pre-service teachers , 2013 .

[5]  Elizabeth Gates Bradley,et al.  A Review of Computer Simulations in Teacher Education , 2014 .

[6]  A. Freitas-Magalhães.  Facial Expression of Emotion , 2012 .

[7]  Charles E. Hughes,et al.  The Potential of Simulated Environments in Teacher Education , 2014 .

[8]  R. Mayer,et al.  Benefits of emotional design in multimedia instruction , 2014 .

[9]  Reinhard Pekrun,et al.  Achievement Emotions: A Control-Value Approach , 2010 .

[10]  A. Ziv,et al.  Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review , 2005, Medical teacher.

[11]  Elizabeth O. Hayward,et al.  Emotional design in multimedia learning: Effects of shape and color on affect and learning , 2014 .

[12]  A. Bernardo,et al.  Positive academic emotions moderate the relationship between self-regulation and academic achievement. , 2013, The British journal of educational psychology.

[13]  Sarah R. Cavanagh,et al.  Cultural differences in recognition of subdued facial expressions of emotions , 2015 .

[14]  E. Meanwell,et al.  The Emotional Experience of First-time Teaching , 2014 .

[15]  Hermann Astleitner,et al.  Designing Emotionally Sound Instruction - an Empirical Validation of the FEASP-Approach , 2001 .

[16]  R. Pekrun.  Using Self-Report to Assess Emotions in Education , 2016 .

[17]  Andy P. Field,et al.  Discovering Statistics Using Ibm Spss Statistics , 2017 .

[18]  J. Keller.  Motivational Design for Learning and Performance , 2010 .

[19]  Roland Brünken,et al.  Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms , 2015, Comput. Educ..

[20]  Sidney D'Mello,et al.  The half-life of cognitive-affective states during complex learning , 2011, Cognition & emotion.

[21]  Marian Stewart Bartlett,et al.  Automatic facial expression recognition for intelligent tutoring systems , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[22]  Gerald Girod,et al.  Exploring the Efficacy of the Cook School District Simulation , 2006 .

[23]  Jan L. Plass,et al.  Interactivity in multimedia learning: An integrated model , 2010, Comput. Hum. Behav..

[24]  D. Berlyne.  Conflict, arousal, and curiosity , 2014 .

[25]  Rosalind W. Picard,et al.  An affective model of interplay between emotions and learning: reengineering educational pedagogy-building a learning companion , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[26]  K. Trigwell.  Relations between teachers’ emotions in teaching and their approaches to teaching in higher education , 2012 .

[27]  David Gibson.  simSchool and the Conceptual Assessment Framework , 2007 .

[28]  D. Kaufman,et al.  Enhancing Teacher Education with Simulations , 2016, TechTrends.

[29]  Klaus R. Scherer,et al.  CONCEPTS AND STRUCTURES OF EMOTIONS , 2014 .

[30]  Mary Margaret Caprano,et al.  Do Differing Types of Field Experiences Make a Difference in Teacher Candidates' Perceived Level of Competence? , 2010 .

[31]  T. Goetz,et al.  Do Girls Really Experience More Anxiety in Mathematics? , 2013, Psychological science.

[32]  Charles E. Hughes,et al.  The virtual academy: A simulated environment for constructionist learning , 1996, Int. J. Hum. Comput. Interact..

[33]  Chris Ohana.  Extended Field Experiences and Cohorts with Elementary Science Methods: Some Unintended Consequences , 2004 .

[34]  T. Goetz,et al.  Academic Emotions in Students' Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research , 2002 .

[35]  D. Kaufman,et al.  Effectiveness of an Online Simulation for Teacher Education. , 2014 .

[36]  Jan L. Plass,et al.  Emotional Design in Digital Media for Learning , 2016 .

[37]  Eunjoon Rachel Um,et al.  Emotional design in multimedia learning. , 2012 .

[38]  A University and Public School Collaborative Approach to Preparing Elementary Teachers. , 1992 .

[39]  Jale Cakiroglu,et al.  Turkish preservice science teachers’ efficacy beliefs regarding science teaching and their beliefs about classroom management , 2007 .

[40]  B. Ferry,et al.  Enhancing the Development of Pre-service Teacher Professional Identity via an Online Classroom Simulation , 2011 .

[41]  Hyo-Jeong So,et al.  Technology's Role in Field Experiences for Preservice Teacher Training , 2009, J. Educ. Technol. Soc..

[42]  Sherry A. Southerland,et al.  "My job isn't to tell them what to think": The Fear of Indoctrination and How it Shapes Education for Sustainable Development , 2011 .

[43]  Robin Williams,et al.  Principles Of Instructional Design 4th Edition , 2015 .

[44]  K. Fiedler,et al.  International handbook of emotions in education. , 2014 .

[45]  Mingyuan Zhang,et al.  Effects of Early Field Experiences on Preservice Teachers' Efficacy Beliefs--A Pilot Study. , 2000 .

[46]  Ryan Shaun Joazeiro de Baker,et al.  Automatic Detection of Learning-Centered Affective States in the Wild , 2015, IUI.

[47]  H. Markus,et al.  Culture and the self: Implications for cognition, emotion, and motivation. , 1991 .

[48]  D. Kaufman,et al.  Design Evaluation of a Simulation for Teacher Education , 2015 .

[49]  J. Keller.  Motivational Design for Learning and Performance: The ARCS Model Approach , 2009 .

[50]  Reinhard Pekrun,et al.  Perceived learning environment and students' emotional experiences: A multilevel analysis of mathematics classrooms. , 2007 .

[51]  S. Hidi,et al.  The Four-Phase Model of Interest Development , 2006 .

[52]  Barney Dalgarno,et al.  Changing directions through VirtualPREX: engaging pre-service teachers in virtual professional experience , 2011 .

[53]  John Lyle,et al.  Stimulated recall: a report on its use in naturalistic research , 2003 .

[54]  S. D’Mello.  A selective meta-analysis on the relative incidence of discrete affective states during learning with technology , 2013 .

[55]  Sarantos Psycharis,et al.  Emotional experiences in simulated classroom training environments , 2016 .

[56]  S. Lindblom-Ylänne,et al.  Emotions and confidence within teaching in higher education , 2011 .

[57]  K. Scherer,et al.  How universal and specific is emotional experience? Evidence from 27 countries on five continents , 1986 .

[58]  David Gibson,et al.  simSchool: an online dynamic simulator for enhancing teacher preparation , 2011, Int. J. Learn. Technol..