Visualization Analysis of Learning Attention Based on Single-image PnP Head Pose Estimation

Learning attention analysis of students is the important indicator of classroom teaching/learning quantitative evaluation. Owing to the fact that the head-mounted eye tracker is expensive and unsuitable to be widely used in the large-scale classroom evaluation under expenditure limitation, in this paper, we uses the PnP(Perspective-nPoint) method to estimate student's head pose for single-image. And then we achieve visualization of learning attention. Experiments demonstrate the following advantages of our method. (1) The method limits the average head-pose estimation errors under 4.88° with Biwi database. (2) This work has implemented student learning attention visualization analyses for three typical learning cases including engagement, attention, and disregard.

[1]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[2]  Luc Van Gool,et al.  Real Time Head Pose Estimation from Consumer Depth Cameras , 2011, DAGM-Symposium.

[3]  Marco Porta,et al.  Emotional e-learning through eye tracking , 2012, Proceedings of the 2012 IEEE Global Engineering Education Conference (EDUCON).

[4]  Nicu Sebe,et al.  Combining Head Pose and Eye Location Information for Gaze Estimation , 2012, IEEE Transactions on Image Processing.

[5]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Peter Robinson,et al.  3D Constrained Local Model for rigid and non-rigid facial tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Victoria Scott Clicking in the Classroom: Using a Student Response System in an Elementary Classroom , 2014 .

[8]  Ioannis Patras,et al.  Multimodal random forest based tensor regression , 2014, IET Comput. Vis..