Video summarization for remote invigilation of online exams

This paper focuses on video summarization of abnormal behavior for remote invigilation of online exams. While the last decade has seen a massive increase in e-learning and online courses offered at postsecondary institutions, preserving the integrity of online examinations still heavily relies on web video conference invigilation performed by a remote proctor. Live remote invigilation is limited in the number of students that can be handled at once, and manual post-exam review is labor intensive. We propose a novel computer vision-based video content analysis system for the automatic creation of video summaries of online exams to assist remote proctors in post-exam reviews. The proposed method models normal and abnormal student behavior patterns using head pose estimations and a semantically meaningful two-state hidden Markov model. Video summaries are created from detected sequences of abnormal behavior. Experimental results are promising and demonstrate the viability of the proposed approach, which could readily be expanded to generate real-time alerts for live remote invigilation.

[1]  Shaogang Gong,et al.  Video Behavior Profiling for Anomaly Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Camille F. Rogers,et al.  Faculty perceptions about e-cheating during online testing , 2006 .

[3]  Konrad Schindler,et al.  Challenges of Ground Truth Evaluation of Multi-target Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Jeffrey L. Bailie,et al.  Online Learner Authentication: Verifying the Identity of Online Users , 2009 .

[5]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[6]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[9]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[10]  Kristine L. Bell,et al.  A Tutorial on Particle Filters for Online Nonlinear/NonGaussian Bayesian Tracking , 2007 .

[11]  Tong Liu,et al.  A fast recognition algorithm for suspicious behavior in high definition videos , 2015, Multimedia Systems.

[12]  Steffen Beich,et al.  Digital Video And Hdtv Algorithms And Interfaces , 2016 .

[13]  Alan F. Smeaton,et al.  An Improved Spatiogram Similarity Measure for Robust Object Localisation , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[14]  Stanley T. Birchfield,et al.  Spatiograms versus histograms for region-based tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, CVPR 2004.

[16]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[17]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[18]  Ian D. Reid,et al.  Colour Invariant Head Pose Classification in Low Resolution Video , 2008, BMVC.

[19]  Tsuhan Chen,et al.  Video-based face recognition using adaptive hidden Markov models , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[20]  Yan Meng,et al.  Abnormal Behavior Recognition Using Self-Adaptive Hidden Markov Models , 2009, ICIAR.

[21]  Clemens Martin,et al.  The Virtual Invigilator: A Network-based Security System for Technology-enhanced Assessments , 2008 .

[22]  Fernando De la Torre,et al.  A Real-Time System for Head Tracking and Pose Estimation , 2010, ECCV Workshops.