An Automated Virtual Receptionist for Recognizing Visitors and Assuring Mask Wearing

Intelligent virtual agents have many societal uses, specifically in situations in which the presence of real humans would be prohibitive. In particular, virtual receptionists can perform a variety of tasks associated with visitor and employee safety, e.g., during the COVID-19 pandemic. In this poster, we present our prototype of a virtual receptionist that employs computer vision and meta-learning techniques to identify and interact with a visitor in a manner similar to that of a real human receptionist. Specifically we employ a meta-learning-based classifier to learn the visitors’ faces from the minimal data collected during a first visit, such that the receptionist can recognize the same visitor during follow-up visits. The system also makes use of deep neural network-based computer vision techniques to recognize whether the visitor is wearing a face mask or not. CCS Concepts • Computing methodologies → Intelligent agents; Object identification;

[1]  Omkar M. Parkhi,et al.  VGGFace2: A Dataset for Recognising Faces across Pose and Age , 2017, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[2]  Damla Turgut,et al.  A Systematic Review of the Convergence of Augmented Reality, Intelligent Virtual Agents, and the Internet of Things , 2019, Artificial Intelligence in IoT.

[3]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Ladislau Bölöni,et al.  Unsupervised Meta-Learning for Few-Shot Image Classification , 2019, NeurIPS.

[5]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[6]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..

[7]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.