IoT Edge Device Based Key Frame Extraction for Face in Video Recognition

Following the development of computing and communication technologies, the idea of Internet of Things (IoT) has been realized not only at research level but also at application level. Among various IoT-related application fields, biometrics applications, especially face recognition, are widely applied in video-based surveillance, access control, law enforcement and many other scenarios. In this paper, we introduce a Face in Video Recognition (FivR) framework which performs real-time key-frame extraction on IoT edge devices, then conduct face recognition using the extracted key-frames on the Cloud back-end. With our key-frame extraction engine, we are able to reduce the data volume hence dramatically relief the processing pressure of the cloud back-end. Our experimental results show with IoT edge device acceleration, it is possible to implement face in video recognition application without introducing the middle-ware or cloud-let layer, while still achieving real-time processing speed.

[1]  Jie Tang,et al.  Enabling Deep Learning on IoT Devices , 2017, Computer.

[2]  Jiye Shi,et al.  The Cloudlet Accelerator: Bringing Mobile-Cloud Face Recognition into Real-Time , 2015, 2015 IEEE Globecom Workshops (GC Wkshps).

[3]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[4]  Chen Liu,et al.  Boosting Face in Video Recognition via CNN Based Key Frame Extraction , 2018, 2018 International Conference on Biometrics (ICB).

[5]  Weng-Fai Wong,et al.  Exploiting half precision arithmetic in Nvidia GPUs , 2017, 2017 IEEE High Performance Extreme Computing Conference (HPEC).

[6]  Wendi B. Heinzelman,et al.  Cloud-Vision: Real-time face recognition using a mobile-cloudlet-cloud acceleration architecture , 2012, 2012 IEEE Symposium on Computers and Communications (ISCC).

[7]  Joo-Hwee Lim,et al.  A Wearable Face Recognition System on Google Glass for Assisting Social Interactions , 2014, ACCV Workshops.

[8]  Kwang-Ting Cheng,et al.  Using mobile GPU for general-purpose computing – a case study of face recognition on smartphones , 2011, Proceedings of 2011 International Symposium on VLSI Design, Automation and Test.

[9]  Chen Liu,et al.  GPU-Accelerated Key Frame Analysis for Face Detection in Video , 2015, 2015 IEEE 7th International Conference on Cloud Computing Technology and Science (CloudCom).

[10]  M. Shamim Hossain,et al.  Cloud-Assisted Speech and Face Recognition Framework for Health Monitoring , 2015, Mobile Networks and Applications.