Class Attendance Checking System based on Deep Learning and Global Optimization

This paper proposes a class attendance checking system based on deep learning approach. Because classrooms are non-constrained environments and each student often has only one sample photo in the learning management system, traditional methods are difficult to achieve good results. Considering the deep learning methods' excellent performance in complex scenes, we build a class attendance checking system using deep learning methods. First, the Faster-RCNN model is used for face detection. Then, we track the detected faces and extract the features of the face images through a CNN model. After calculating the distance between the detected face features and the sample face features, a global optimization method is used to accomplish the recognition of all face tracks at the same time. This paper begins with an introduction to the application background, and reviews the related works in the field of face-recognition-based attendance checking in the classroom. Then, this paper introduces our system architecture and the methodology used in each section. Finally, we test the system on real class surveillance videos. The results demonstrate the validity of our system architecture and the methods we used.

[1]  Huaizu Jiang,et al.  Face Detection with the Faster R-CNN , 2016, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[2]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Marios Savvides,et al.  CMS-RCNN: Contextual Multi-Scale Region-based CNN for Unconstrained Face Detection , 2016, ArXiv.

[4]  Giancarlo Iannizzotto,et al.  A Person Authentication System Based on RFID Tags and a Cascade of Face Recognition Algorithms , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Yohei KAWAGUCHI,et al.  Face Recognition-based Lecture Attendance System , 2005 .

[6]  Haohan Li,et al.  Who missed the class? — Unifying multi-face detection, tracking and recognition in videos , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[7]  Steven C. H. Hoi,et al.  Face Detection using Deep Learning: An Improved Faster RCNN Approach , 2017, Neurocomputing.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Visar Shehu,et al.  Using real time computer vision algorithms in automatic attendance management systems , 2010, Proceedings of the ITI 2010, 32nd International Conference on Information Technology Interfaces.

[10]  Waqar Ahmad,et al.  Algorithm for Efficient Attendance Management: Face Recognition based approach , 2012 .

[11]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[12]  M. V. Raghunadh,et al.  Automated attendance management system based on face recognition algorithms , 2013, 2013 IEEE International Conference on Computational Intelligence and Computing Research.

[13]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Xiaogang Wang,et al.  Deeply learned face representations are sparse, selective, and robust , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Surekha Borra,et al.  Attendance management system using hybrid face recognition techniques , 2016, 2016 Conference on Advances in Signal Processing (CASP).

[16]  Omaima N. A. AL-Allaf,et al.  INTEGRATED SYSTEM FOR MONITORING AND RECOGNIZING STUDENTS DURING CLASS SESSION , 2013 .

[17]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[18]  Abhishek Jha,et al.  Class Room Attendance System Using Facial Recognition System , 2013 .

[19]  Yu Qiao,et al.  Latent Factor Guided Convolutional Neural Networks for Age-Invariant Face Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Lei Zhang,et al.  One-shot Face Recognition by Promoting Underrepresented Classes , 2017, ArXiv.

[21]  Shuo Yang,et al.  WIDER FACE: A Face Detection Benchmark , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Shengcai Liao,et al.  Learning Face Representation from Scratch , 2014, ArXiv.

[23]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[24]  Ririn Ikana Desanti,et al.  Student attendance system in classroom using face recognition technique , 2016, 2016 International Conference on Information and Communication Technology Convergence (ICTC).