CMAC: Collaborative multi agent computing for multi perspective multi screen immersive e-learning system

Traditional e-Learning systems like Vidyo, Skype, Hangouts, A-View etc. do not ensure proper gaze alignment among the remote participants. Our research has shown that a gaze aligned multi-perspective multi-screen e-Learning system provides much better immersive experience. To provide multiple perspectives of the participants, we are using 5 cameras at each participant location, each one separated by 45 degrees, covering a range of 180 degrees, so that the system can choose appropriate perspective to present to the remote participants based on set of rules. We realized that a single standard computer is not able to capture and stream more than 2 HD video streams reliably, so we had to design a flexible multi-agent system to distribute the video streaming across 3 computers at each classroom. In this paper we present the architecture of our Smart classroom system, CMAC.

[1]  Geoffrey C. Fox,et al.  AVATS: Audio-video and textual synchronization , 2009, 2009 International Symposium on Collaborative Technologies and Systems.

[2]  Yo-Sung Ho,et al.  Gaze correction using 3D video processing for videoconferencing , 2015, 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP).

[3]  P. Venkat Rangan,et al.  Automatic multi-perspective switching for gaze alignment in eLearning systems , 2015 .

[4]  Louise E. Moser,et al.  A Collaborative Computing Infrastructure based on atom , 2008, 2008 International Symposium on Collaborative Technologies and Systems.

[5]  Christian Callegari,et al.  Advances in Computing, Communications and Informatics (ICACCI) , 2015 .

[6]  Yo-Sung Ho,et al.  Eye Gaze Correction for Video Conferencing Using Kinect v2 , 2015, PCM.

[7]  Anthony Steed,et al.  A Surround Video Capture and Presentation System for Preservation of Eye-Gaze in Teleconferencing Applications , 2015, PRESENCE: Teleoperators and Virtual Environments.

[8]  Stephen R. Acker,et al.  Designing Videoconference Facilities for Improved Eye Contact. , 1987 .