Multimodal Assessment on Teaching Skills via Neural Networks

Repeated training of teaching skills for student teachers is difficult as many collaborators should be needed for rehearsal environment. Therefore, we are studying a teaching training system using virtual classroom which is constructed by virtual agents as students. In order to construct such a training system, an automatic assessment of human behaviour by the system is required. On the other hand, it is difficult to assess teaching skills in term of educational environment due to complex interactions with many students and subjectivity of the task of teaching assessment. In this study, we propose an assessment model by neural networks (NN) to learn more potential assessment features using multi-modal information: gesture and prosodic information, facial expressions, and the teacher’s intention.