Student in the shell: The robotic body and student engagement

Abstract The purpose of this case study was to explore how the embodiment of graduate students in robotic surrogates was related to their engagement in a class with other robotically and non-robotically embodied classmates. Using a mixed methods design, we collected survey and in-class observational data on the students' perceptions of their robotic bodies and their engagement in the course. Applying linear models and thematic analysis, we sought to identify prevailing patterns of students' use their robotic bodies to engage in their learning. Our findings suggest that nonverbal communication with one's robotic body is a dominant form of interaction and engagement in synchronous learning contexts and multiple contextual factors affect robotic students' engagement. Specifically, the capabilities of the robotic surrogate and the student's perceptions of the surrogate as an extension of their own body may influence their engagement in educational contexts. Patterns of robotic and nonverbal behaviors may also vary with instructional context and social learning. For robotically telepresent students, embodiment becomes a central factor to their engagement and should be included in theories of engagement in technology-mediated contexts that involve surrogate bodies.

[1]  Florence Martin,et al.  Examining Interactivity in Synchronous Virtual Classrooms. , 2012 .

[2]  A. Mehrabian,et al.  Inference of attitudes from nonverbal communication in two channels. , 1967, Journal of consulting psychology.

[3]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[4]  Munsang Kim,et al.  Easy Interface and Control of Tele-education Robots , 2013, Int. J. Soc. Robotics.

[5]  A. Mehrabian Some referents and measures of nonverbal behavior , 1968 .

[6]  John Short,et al.  The social psychology of telecommunications , 1976 .

[7]  J. Bailenson,et al.  The Use of Immersive Virtual Reality in the Learning Sciences: Digital Transformations of Teachers, Students, and Social Context , 2008 .

[8]  Dahlia K. Remler,et al.  Research Methods in Practice: Strategies for Description and Causation , 2010 .

[9]  H. M. Marks,et al.  Student Engagement in Instructional Activity: Patterns in the Elementary, Middle, and High School Years , 2000 .

[10]  Peter Arnfalk,et al.  Service transformation—managing a shift from business travel to virtual meetings , 2003 .

[11]  Curtis J. Bonk,et al.  Synchronous Learning Experiences: Distance and Residential Learners' Perspectives in a Blended Graduate Course. , 2007 .

[12]  C. Goodwin Action and embodiment within situated human interaction , 2000 .

[13]  Lisa Linnenbrink-Garcia,et al.  Students emotions and academic engagement: Introduction to the special issue , 2011 .

[14]  George Bradford A relationship study of student satisfaction with learning online and cognitive load: Initial results , 2011, Internet High. Educ..

[15]  Silvia Coradeschi,et al.  A Review of Mobile Robotic Telepresence , 2013, Adv. Hum. Comput. Interact..

[16]  S. G. Little,et al.  Psychology's Contributions to Classroom Management. , 2008 .

[17]  W. Briggs,et al.  A Measure of College Student Course Engagement , 2005 .

[18]  Chrystopher L. Nehaniv,et al.  Interactive Language Learning by Robots: The Transition from Babbling to Word Forms , 2012, PloS one.

[19]  Stefan Hrastinski,et al.  Asynchronous and synchronous e-learning , 2008 .

[20]  Philip Yaffe,et al.  The 7% rule: fact, fiction, or misunderstanding , 2011, UBIQ.

[21]  S. Barab,et al.  Transformational Play , 2010 .

[22]  Neil Pitcher,et al.  Videoconferencing in Higher Education , 2000 .

[23]  Saso Koceski,et al.  Evaluation of an Assistive Telepresence Robot for Elderly Healthcare , 2016, Journal of Medical Systems.

[24]  Kevin R. Guidry,et al.  Engaging online learners: The impact of Web-based learning technology on college student engagement , 2010, Comput. Educ..

[25]  George D. Kuh,et al.  Student Engagement and Student Learning: Testing the Linkages* , 2006 .

[26]  Boris N. Goldowsky,et al.  Supporting engagement and comprehension online through multiple means of expression , 2016, W4A.

[27]  Charles R. Graham,et al.  Measuring student engagement in technology-mediated learning: A review , 2015, Comput. Educ..

[28]  Lisa Linnenbrink-Garcia,et al.  Academic Emotions and Student Engagement , 2012 .

[29]  R. Birdwhistell Kinesics and Context: Essays on Body Motion Communication , 1971 .

[30]  S. Christenson,et al.  Jingle, Jangle, 1 and Conceptual Haziness 2 : Evolution and Future Directions of the Engagement Construct , 2012 .

[31]  Donald Gillies,et al.  Student perspectives on videoconferencing in teacher education at a distance , 2008 .

[32]  J. Connell,et al.  What It Takes to Do Well in School and Whether I've Got It: A Process Model of Perceived Control and Children's Engagement and Achievement in School , 1990 .

[33]  Cher Ping Lim,et al.  Gaming in a 3D multiuser virtual environment: engaging students in Science lessons , 2006, Br. J. Educ. Technol..

[34]  Reynol Junco,et al.  The effect of Twitter on college student engagement and grades , 2011, J. Comput. Assist. Learn..

[35]  Robert M. Gonyea,et al.  Unmasking the Effects of Student Engagement on First-Year College Grades and Persistence , 2008 .

[36]  Sungjin Lee,et al.  On the effectiveness of Robot-Assisted Language Learning , 2011, ReCALL.

[37]  N. Sheeran,et al.  An examination of the relationship between Facebook groups attached to university courses and student engagement , 2018 .

[38]  David Lapakko,et al.  Three Cheers for Language: A Closer Examination of a Widely Cited Study of Nonverbal Communication. , 1997 .

[39]  Tassos A. Mikropoulos,et al.  Educational virtual environments: A ten-year review of empirical research (1999-2009) , 2011, Comput. Educ..

[40]  Nian-Shing Chen,et al.  Is FLIP enough? Or should we use the FLIPPED model instead? , 2014, Comput. Educ..

[41]  Esmail Bonakdarian,et al.  Merging worlds: when virtual meets physical: an experiment with hybrid learning , 2009 .

[42]  Leila Takayama,et al.  "Now, i have a body": uses and social norms for mobile remote presence in the workplace , 2011, CHI.

[43]  Amedeo Cesta,et al.  Long-Term Evaluation of a Telepresence Robot for the Elderly: Methodology and Ecological Case Study , 2016, International Journal of Social Robotics.

[44]  R. Shaw,et al.  A Telehealth Case Study , 2015, Journal of the American Psychiatric Nurses Association.

[45]  Elson Szeto,et al.  Towards a framework of interactions in a blended synchronous learning environment: what effects are there on students' social presence experience? , 2016, Interact. Learn. Environ..

[46]  Daniela Sime,et al.  What do learners make of teachers' gestures in the language classroom? , 2006 .

[47]  John Ainley,et al.  Student engagement with science in early adolescence : the contribution of enjoyment to students' continuing interest in learning about science , 2011 .

[48]  Kun Zhou,et al.  Real-time facial animation with image-based dynamic avatars , 2016, ACM Trans. Graph..

[49]  Richard Bloss High school student goes to class robotically , 2011, Ind. Robot.

[50]  William Cain,et al.  Virtual Presence in a Synchromodal Learning Environment , 2014 .

[51]  J. Bavelas,et al.  Visible Acts of Meaning , 2000 .

[52]  James. C. Squire,et al.  The Difference In The Effects Of Longitudinal Effects Of Network Latency On STEM And Non-STEM Students , 2016 .

[53]  G. Wheatley,et al.  Learning opportunities and negotiating social norms in mathematics class discussion , 1994 .

[54]  Frank Biocca,et al.  The Cyborg's Dilemma: Progressive Embodiment in Virtual Environments , 2006, J. Comput. Mediat. Commun..

[55]  C. C. Robinson,et al.  New Benchmarks in Higher Education: Student Engagement in Online Learning , 2008 .

[56]  Frank Biocca,et al.  Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria , 2003, Presence: Teleoperators & Virtual Environments.

[57]  Shane R. Jimerson,et al.  The Student Engagement in Schools Questionnaire (SESQ) and the Teacher Engagement Report Form-New (TERF-N): Examining the Preliminary Evidence , 2011, Contemporary School Psychology.

[58]  P. Ekman Should we call it expression or communication , 1997 .

[59]  Katherine M. Tsui,et al.  Exploring use cases for telepresence robots , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[60]  R. MacLeod,et al.  Low Latency Audio Video , 2016 .

[61]  S. Baker,et al.  Using Virtual Worlds in Education: Second Life® as an Educational Tool , 2009 .

[62]  Shelia R. Cotten,et al.  Perceived academic effects of instant messaging use , 2011, Comput. Educ..

[63]  M. Lombard,et al.  Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability , 2002 .

[64]  John Bell,et al.  From 2D to Kubi to Doubles: Designs for Student Telepresence in Synchronous Hybrid Classrooms , 2016 .

[65]  Jodi L. Davenport,et al.  Scene Consistency in Object and Background Perception , 2004, Psychological science.

[66]  Hsien-I Lin,et al.  A Novel Teaching System for Industrial Robots , 2014, Sensors.

[67]  Edward Palmer,et al.  Personalising learning: Exploring student and teacher perceptions about flexible learning and assessment in a flipped university course , 2015, Comput. Educ..

[68]  D. Randy Garrison,et al.  Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education , 1999, Internet High. Educ..

[69]  Andrew J. Martin,et al.  Boarding School, Academic Motivation and Engagement, and Psychological Well-Being , 2014 .

[70]  Michael A. Herbert Staying the Course: A Study in Online Student Satisfaction and Retention , 2006 .

[71]  Aryn M. Dotterer,et al.  Classroom Context, School Engagement, and Academic Achievement in Early Adolescence , 2011, Journal of youth and adolescence.

[72]  M. Roblyer,et al.  Findings on Facebook in higher education: A comparison of college faculty and student uses and perceptions of social networking sites , 2010, Internet High. Educ..

[73]  J. K. Dixon,et al.  Do They Really Need to Raise Their Hands? Challenging a Traditional Social Norm in a Second Grade Mathematics Classroom. , 2009 .

[74]  Dianne Conrad,et al.  Engagement, Excitement, Anxiety, and Fear: Learners' Experiences of Starting an Online Course , 2002 .

[75]  W. Hannum,et al.  Reasons for student dropout in an online course in a rural K–12 setting , 2014 .

[76]  C. Gunawardena Social Presence Theory and Implications for Interaction and Collaborative Learning in Computer Conferences , 1995 .

[77]  Jeremy N. Bailenson,et al.  The Effect of Behavioral Realism and Form Realism of Real-Time Avatar Faces on Verbal Disclosure, Nonverbal Disclosure, Emotion Recognition, and Copresence in Dyadic Interaction , 2006, PRESENCE: Teleoperators and Virtual Environments.

[78]  Charles R. Graham A Model of Norm Development for Computer-Mediated Teamwork , 2003 .

[79]  Hamish Coates,et al.  A model of online and general campus‐based student engagement , 2007 .

[80]  G. Smith,et al.  Student Attrition in Mathematics E-Learning , 2005 .

[81]  George D. Kuh,et al.  Adding Value: Learning Communities and Student Engagement , 2004 .

[82]  Michelle Drouin,et al.  The Relationship Between Students' Perceived Sense of Community and Satisfaction, Achievement, and Retention in an Online Course , 2008 .

[83]  Fotini Paraskeva,et al.  Teaching Role-Playing Instruction in Second Life: An Exploratory Study , 2010 .

[84]  David J. Shernoff,et al.  Student engagement in high school classrooms from the perspective of flow theory. , 2003 .

[85]  Timothy G. Hegstrom,et al.  Message impact: What percentage is nonverbal? , 1979 .

[86]  Karen Swan,et al.  Virtual interaction: Design factors affecting student satisfaction and perceived learning in asynchronous online courses , 2001 .

[87]  Michael C. Rodriguez,et al.  Meta-analysis of coefficient alpha. , 2006, Psychological methods.

[88]  Elizabeth Murphy,et al.  Identifying and measuring individual engagement in critical thinking in online discussions: An exploratory case study , 2006, J. Educ. Technol. Soc..

[89]  C. Greenwood,et al.  Academic Engagement: Current Perspectives on Research and Practice , 2002 .

[90]  Mitchell J. Nathan,et al.  Embodiment in Mathematics Teaching and Learning: Evidence From Learners' and Teachers' Gestures , 2012 .

[91]  Michele D. Dickey Three-dimensional virtual worlds and distance learning: two case studies of Active Worlds as a medium for distance education , 2005, Br. J. Educ. Technol..

[92]  James J. Appleton,et al.  Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument , 2006 .

[93]  E. Skinner,et al.  Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. , 1993 .

[94]  Stacy Olitsky,et al.  Promoting student engagement in science: Interaction rituals and the pursuit of a community of practice , 2007 .

[95]  D. R. Thomas,et al.  Rules, praise, and ignoring: elements of elementary classroom control. , 1968, Journal of applied behavior analysis.

[96]  Joseph P. Mazer Development and Validation of the Student Interest and Engagement Scales , 2012 .

[97]  Wijnand A. IJsselsteijn,et al.  Embodiment and telepresence: Toward a comprehensive theoretical framework , 2012, Interact. Comput..

[98]  A. Mehrabian Significance of posture and posiion in the communication of attitude and status relationships. , 1969, Psychological bulletin.

[99]  A Multicenter Study of Students' Sensitivity to Screen-Update Delay. , 2011 .

[100]  Cary J. Roseth,et al.  A tale of two courses: Innovation in the Hybrid/Online Doctoral Program at Michigan State University , 2014 .

[101]  Bente Meyer,et al.  Learning through telepresence with iPads: placing schools in local/global communities , 2015, Interact. Technol. Smart Educ..

[102]  C. Laing,et al.  A Conceptual Framework for Evaluating Attrition in Online Courses , 2015 .

[103]  Pavel Zahorik,et al.  Presence as Being-in-the-World , 1998, Presence.

[104]  Robyn Smyth Broadband videoconferencing as a tool for learner-centred distance learning in higher education , 2005, Br. J. Educ. Technol..

[105]  Andrew F. Monk,et al.  Some advantages of video conferencing over high-quality audio conferencing: fluency and awareness of attentional focus , 1998, Int. J. Hum. Comput. Stud..

[106]  Heng-Yu Ku,et al.  Collaboration factors, teamwork satisfaction, and student attitudes toward online collaborative learning , 2013, Comput. Hum. Behav..

[107]  Lu Ding,et al.  Studies of student engagement in gamified online discussions , 2017, Comput. Educ..

[108]  Marcia D. Dixson,et al.  Nonverbal immediacy behaviors and online student engagement: bringing past instructional research into the present virtual classroom , 2017 .

[109]  Woodrow Barfield,et al.  Presence within Virtual Environments as a Function of Visual Display Parameters , 1996, Presence: Teleoperators & Virtual Environments.

[110]  Carol C. Dudding,et al.  Digital Videoconferencing , 2009 .

[111]  Marc A. Brackett,et al.  Classroom emotional climate, student engagement, and academic achievement , 2012 .

[112]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[113]  T. Kindermann,et al.  A Motivational Perspective on Engagement and Disaffection , 2009 .

[114]  Autumn B. Hostetter,et al.  When do gestures communicate? A meta-analysis. , 2011, Psychological bulletin.

[115]  Anders Norberg,et al.  Blended Learning and New Education Logistics in Northern Sweden , 2012 .

[116]  David F. Bicard,et al.  Classroom Behavior Management: A Dozen Common Mistakes and What to Do Instead , 2005 .

[117]  Curtis LeBaron,et al.  Research on the Relationship Between Verbal and Nonverbal Communication: Emerging Integrations , 2002 .

[118]  A. Mehrabian,et al.  Decoding of inconsistent communications. , 1967, Journal of personality and social psychology.