A Cross-Camera Multi-Face Tracking System Based on Double Triplet Networks

The aim of this study is to track the faces of all pedestrians in the video surveillance. Face images from each camera can use Chinese Whisper face clustering algorithm to cluster the same person’s face together, and according to the results of face clustering to find out which people through the camera. Double Triplet Networks (DTN) designed in this study is used to learn the depth features of human face. DTN is trained on LFW data set, and the model trained can improve its recognition accuracy to 99.51% by Margin Sample Mining Loss (MSML) and Focal Loss hard sample equalization. Comparing the similarity of the facial features in same video surveillance areas can track the faces of pedestrians, and comparing the similarity of the facial features in different video surveillance areas can predict which camera area the face comes from and tracking the sequential paths of pedestrians through these areas. Cross-camera face tracking is possible by transmitting facial features between cameras in real-time.

[1]  Luc Van Gool,et al.  Probabilistic Regression for Visual Tracking , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Bo Li,et al.  Constrained discriminant neighborhood embedding for high dimensional data feature extraction , 2016, Neurocomputing.

[3]  Anubhav Gupta,et al.  Scanned to Digital Face Images Matching With Siamese Network , 2018, 2018 3rd International Conference and Workshops on Recent Advances and Innovations in Engineering (ICRAIE).

[4]  Qingjie He,et al.  GMM Clustering-Based Decision Trees Considering Fault Rate and Cluster Validity for Analog Circuit Fault Diagnosis , 2019, IEEE Access.

[5]  Pong C. Yuen,et al.  PurifyNet: A Robust Person Re-Identification Model With Noisy Labels , 2020, IEEE Transactions on Information Forensics and Security.

[6]  Wang Yang,et al.  Real-time face detection based on YOLO , 2018, 2018 1st IEEE International Conference on Knowledge Innovation and Invention (ICKII).

[7]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Ying Hung,et al.  A Prior-Less Method for Multi-face Tracking in Unconstrained Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Shunzhi Zhu,et al.  Clustering Geospatial Data for Multiple Reference Points , 2019, IEEE Access.

[10]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Edward J. Delp,et al.  A Two Stream Siamese Convolutional Neural Network for Person Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Zhenyu He,et al.  The Seventh Visual Object Tracking VOT2019 Challenge Results , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[13]  M F E Pratama,et al.  Digital News Graph Clustering using Chinese Whispers Algorithm , 2017 .

[14]  Lina Ni,et al.  DP-MCDBSCAN: Differential Privacy Preserving Multi-Core DBSCAN Clustering for Network User Data , 2018, IEEE Access.

[15]  R. Sujatha,et al.  FACE TRACKING ALGORITHM FOR TRACKING TARGET IN WSN , 2018 .

[16]  Haipeng Yao,et al.  MSML: A Novel Multilevel Semi-Supervised Machine Learning Framework for Intrusion Detection System , 2019, IEEE Internet of Things Journal.

[17]  Ping Gong,et al.  A generalized Kernel Fisher Discriminant framework used for feature extraction and face recognition , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[18]  Kaiqi Huang,et al.  Beyond Triplet Loss: A Deep Quadruplet Network for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[20]  Mohammed Ghazal,et al.  A Comparison between Google Cloud Service and iCloud , 2019, 2019 IEEE 4th International Conference on Computer and Communication Systems (ICCCS).

[21]  Dacheng Tao,et al.  Multi-task Learning with Coarse Priors for Robust Part-aware Person Re-identification , 2020, IEEE transactions on pattern analysis and machine intelligence.

[22]  Michael Felsberg,et al.  The Visual Object Tracking VOT2017 Challenge Results , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[23]  Michael Felsberg,et al.  Learning What to Learn for Video Object Segmentation , 2020, ECCV.

[24]  Sean M. Kennedy,et al.  Cluster-Based Spectral-Spatial Segmentation of Hyperspectral Imagery , 2020, IEEE Access.

[25]  Xu Liu,et al.  Multi-face real-time tracking based on dual panoramic camera for full-parallax light-field display , 2019, Optics Communications.

[26]  Guangyao Shi,et al.  Unsupervised Dimensionality Reduction for Hyperspectral Imagery via Local Geometric Structure Feature Learning , 2020, IEEE Geoscience and Remote Sensing Letters.

[27]  Luc Van Gool,et al.  Generating Masks from Boxes by Mining Spatio-Temporal Consistencies in Videos , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[28]  Christian Biemann,et al.  Chinese Whispers - an Efficient Graph Clustering Algorithm and its Application to Natural Language Processing Problems , 2006 .

[29]  Aiko Pras,et al.  Inside dropbox: understanding personal cloud storage services , 2012, Internet Measurement Conference.

[30]  Jenq-Neng Hwang,et al.  Facial Feature-Integrated Inter-Camera Human Tracking , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Kwangjin Yoon,et al.  Online Multi-Object Tracking Using Selective Deep Appearance Matching , 2018, 2018 IEEE International Conference on Consumer Electronics - Asia (ICCE-Asia).

[32]  Kim-Kwang Raymond Choo,et al.  Google Drive: Forensic analysis of data remnants , 2014, J. Netw. Comput. Appl..

[33]  Xiaoou Tang,et al.  Joint Face Representation Adaptation and Clustering in Videos , 2016, ECCV.

[34]  L. Gool,et al.  Learning Discriminative Model Prediction for Tracking , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[35]  Song Wang,et al.  Learning Dynamic Siamese Network for Visual Object Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Wei Chen,et al.  A Novel Hard Mining Center-Triplet Loss for Person Re-identification , 2019, PRCV.

[37]  Xudong Jiang,et al.  Deep Coupled ResNet for Low-Resolution Face Recognition , 2018, IEEE Signal Processing Letters.

[38]  Georgios Tzimiropoulos,et al.  How Far are We from Solving the 2D & 3D Face Alignment Problem? (and a Dataset of 230,000 3D Facial Landmarks) , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[39]  Xinguo Yu,et al.  Robust Face Tracking Using Siamese-VGG with Pre-training and Fine-tuning , 2019, 2019 4th International Conference on Control and Robotics Engineering (ICCRE).

[40]  Fubiao Feng,et al.  Dimensionality Reduction of Hyperspectral Image with Graph-Based Discriminant Analysis Considering Spectral Similarity , 2017, Remote. Sens..

[41]  Xi Zhou,et al.  Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network , 2018, ECCV.

[42]  Michael Felsberg,et al.  The Visual Object Tracking VOT2015 Challenge Results , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[43]  Haipeng Chen,et al.  Copy-Move Forgery Detection Based on Keypoint Clustering and Similar Neighborhood Search Algorithm , 2020, IEEE Access.

[44]  Xiangyu Zhu,et al.  Face Alignment in Full Pose Range: A 3D Total Solution , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Haiyuan Wu,et al.  Face and facial feature extraction from color image , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[46]  Swagatam Das,et al.  Entropy Weighted Power k-Means Clustering , 2020, AISTATS.