Inferring Student's Attention in a Machine Learning Approach: A Feasibility Study

It is important that students should learn with full attention to achieve desired outcomes. In this paper, we propose a multi-modal assistant system for intelligent learning, which may capture and analyze the video and audio of student's learning process. We design and implement a machine learning framework to infer student's attention in order to effectively help the teacher to facilitate appropriate learning activities. Such capacity may also help achieve personalized learning recommendation for students. Our preliminary study demonstrate the feasibility of this multi-modal inference of attention in order to develop effective learning analytic towards formative assessment.

[1]  Xiaojun Hei,et al.  Accelerating a Secure Programmable Edge Network System for Smart Classroom , 2018, 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[2]  Justin Dauwels,et al.  Inferring the Climate in Classrooms from Audio and Video Recordings: A Machine Learning Approach , 2018, 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE).

[3]  Yelin Kim,et al.  Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and Education , 2018, IEEE Access.

[4]  Yuan Wu,et al.  Delay-Minimization Nonorthogonal Multiple Access Enabled Multi-User Mobile Edge Computation Offloading , 2019, IEEE Journal of Selected Topics in Signal Processing.

[5]  Judy Kay,et al.  Data Mining in the Classroom: Discovering Groups' Strategies at a Multi-tabletop Environment , 2013, EDM.

[6]  Liang Xiao,et al.  Towards Smart Educational Recommendations with Reinforcement Learning in Classroom , 2018, 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE).

[7]  Srdjan Krco,et al.  Smart classroom system for detecting level of interest a lecture creates in a classroom , 2015, J. Ambient Intell. Smart Environ..