Monitoring Students' Attention in a Classroom Through Computer Vision

Monitoring classrooms using cameras is a non-invasive approach of digitizing students’ behaviour. Understanding students’ attention span and what type of behaviours may indicate a lack of attention is fundamental for understanding and consequently improving the dynamics of a lecture. Recent studies show useful information regarding classrooms and their students’ behaviour throughout the lecture. In this paper we start by presenting an overview about the state of the art on this topic, presenting what we consider to be the most robust and efficient Computer Vision techniques for monitoring classrooms. After the analysis of relevant state of the art, we propose an agent that is theoretically capable of tracking the students’ attention and output that data. The main goal of this paper is to contribute to the development of an autonomous agent able to provide information to both teachers and students and we present preliminary results on this topic. We believe this autonomous agent features the best solution for monitoring classrooms since it uses the most suited state of the art approaches for each individual role.

[1]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Li-Jia Li,et al.  Multi-view Face Detection Using Deep Convolutional Neural Networks , 2015, ICMR.

[3]  George D. Kuh,et al.  Student Engagement and Student Learning: Testing the Linkages* , 2006 .

[4]  Wojciech Matusik,et al.  Eye Tracking for Everyone , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Simone Volet,et al.  Teacher emotions in the classroom: associations with students’ engagement, classroom discipline and the interpersonal teacher-student relationship , 2015 .

[6]  Pierre Dillenbourg,et al.  System for assessing classroom attention , 2013, LAK '13.

[7]  Pierre Dillenbourg,et al.  Translating Head Motion into Attention - Towards Processing of Student's Body-Language , 2015, EDM.

[8]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[9]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[10]  António J. R. Neves,et al.  Self-calibration of Colormetric Parameters in Vision Systems for Autonomous Soccer Robots , 2013, RoboCup.

[11]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[12]  Peter Blatchford,et al.  Examining the effect of class size on classroom engagement and teacher–pupil interaction: Differences in relation to pupil prior attainment and primary vs. secondary schools , 2011 .

[13]  Zuying Luo,et al.  University Classroom Attendance Based on Deep Learning , 2017, 2017 10th International Conference on Intelligent Computation Technology and Automation (ICICTA).

[14]  Vincenza Carchiolo,et al.  Monitoring students activities in CS courses , 2016, 2016 15th RoEduNet Conference: Networking in Education and Research.

[15]  Alexandra Poulovassilis,et al.  Scalable Monitoring of Student Interaction Indicators in Exploratory Learning Environments , 2016, WWW.

[16]  Jie Zhu,et al.  Head orientation and gaze direction in meetings , 2002, CHI Extended Abstracts.