A Networked Social Virtual Reality Learning Environment Platform for Special Education

Delivering curriculum using desktop-based virtual learning environment (VLE) technologies in a collaborative group setting has been shown to reduce the social skill limitations of students with learning disabilities. However, the lack of the immersiveness and effective generalization of acquiring knowledge and skills among students remains a critical challenge in the interactive tools used in current VLEs. In this paper, we present a networked social virtual reality learning environment (VRLE) system viz., vSocial that has been redesigned based on iterative user feedback and developed in order to leverage the latest advances in integration of smart devices such as VR headsets for virtual content delivery. We describe a comparative study to evaluate technology trade-offs in the development process of transitioning from a VLE to a VRLE, from both technological and user (e.g., student/instructor) perspectives. Lastly, we outline open issues in using VRLEs which include: system complexity, emotion recognition, cybersickness and system sustainability.

[1]  Zhihai He,et al.  vSocial: a cloud-based system for social virtual reality learning environment applications in special education , 2020, Multimedia Tools and Applications.

[2]  J. Laffey,et al.  Fostering verbal and non-verbal social interactions in a 3D collaborative virtual learning environment: a case study of youth with Autism Spectrum Disorders learning social competence in iSocial , 2017 .

[3]  Mel Slater,et al.  Enhancing Our Lives with Immersive Virtual Reality , 2016, Front. Robot. AI.

[4]  Daniel C. Krawczyk,et al.  Virtual Reality Social Cognition Training for children with high functioning autism , 2016, Comput. Hum. Behav..

[5]  Jim Groom,et al.  Docker - Build, Ship, and Run Any App, Anywhere , 2014 .

[6]  Xianhui Wang,et al.  Developing methods for understanding social behavior in a 3D virtual learning environment , 2012, Comput. Hum. Behav..

[7]  James Laffey,et al.  iSocial: Delivering the Social Competence Intervention for Adolescents (SCI-A) in a 3D Virtual Learning Environment for Youth with High Functioning Autism , 2013, Journal of Autism and Developmental Disorders.

[8]  Victoria M. López,et al.  Interactive System to Improve the Skills of Children with Dyslexia: A Preliminary Study , 2019, Smart Innovation, Systems and Technologies.

[9]  Vishav Jyoti,et al.  Human-Computer Interaction based Joint Attention cues: Implications on functional and physiological measures for children with autism spectrum disorder , 2020, Comput. Hum. Behav..

[10]  Fillia Makedon,et al.  Brain-EE: Brain Enjoyment Evaluation using Commercial EEG Headband , 2016, PETRA.

[11]  Sehat Ullah,et al.  Adaptive 3D-Virtual Learning Environments: From Students' Learning Perspective , 2016, 2016 International Conference on Frontiers of Information Technology (FIT).

[12]  Zhihai He,et al.  Towards a social virtual reality learning environment in high fidelity , 2017, 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[13]  Yulei Fan,et al.  Collaborative Virtual Environment Technology for People With Autism , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[14]  D. Oprean,et al.  Designing for Social Interaction and Social Competence in a 3D-VLE , 2010 .

[15]  Eleonora Bilotta,et al.  An emotional learning environment for subjects with Autism Spectrum Disorder , 2013, 2013 International Conference on Interactive Collaborative Learning (ICL).

[16]  Sean P. Goggins,et al.  The Design of iSocial: A Three-Dimensional, Multi-user, Virtual Learning Environment for Individuals with Autism Spectrum Disorders to Learn Social Skills , 2008 .

[17]  Jihad Mohamad Jaam,et al.  Immersive Virtual Reality in Improving Communication Skills in Children with Autism , 2017, Int. J. Interact. Mob. Technol..

[18]  J. Stichter,et al.  MANUALIZATION, FEASIBILITY, AND EFFECTIVENESS OF THE SCHOOL‐BASED SOCIAL COMPETENCE INTERVENTION FOR ADOLESCENTS (SCI‐A) , 2016 .

[19]  H. Ip,et al.  Using virtual reality to train emotional and social skills in children with autism spectrum disorder , 2018, London journal of primary care.

[20]  Jun Ye,et al.  Exploring the social competence of students with autism spectrum conditions in a collaborative virtual learning environment - The pilot study , 2010, Comput. Educ..

[21]  H. McConachie,et al.  A Randomised Controlled Feasibility Trial of Immersive Virtual Reality Treatment with Cognitive Behaviour Therapy for Specific Phobias in Young People with Autism Spectrum Disorder , 2019, Journal of Autism and Developmental Disorders.