Design of a CNN Face Recognition System Dedicated to Blinds

Identifying other persons is a major challenge for blinds and visually impaired people that can hinder interaction in social activities. This paper introduces a novel CNN based face detection, tacking and recognition system designed to improve users’ interaction and communication in social encounters. The major contribution consists in a novel weight adaptation scheme able to determine the relevance of face instances and to create a global, fixed-size representation from all face instances tracked during the video stream, while remaining independent of the track length. The experimental evaluation performed on a large set of video streams validates the approach that returns accuracy and recognition rates superior to 90%.

[1]  Minho Lee,et al.  Smart Cane: Face Recognition System for Blind , 2015, HAI.

[2]  Ruxandra Tapu,et al.  Single object tracking using offline trained deep regression networks , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[3]  Huaizu Jiang,et al.  Face Detection with the Faster R-CNN , 2016, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[4]  Shuo Yang,et al.  WIDER FACE: A Face Detection Benchmark , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael Felsberg,et al.  The Visual Object Tracking VOT2017 Challenge Results , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Ruxandra Tapu,et al.  DEEP-SEE: Joint Object Detection, Tracking and Recognition with Application to Visually Impaired Navigational Assistance , 2017, Sensors.