Face Recognition Using an Outdoor Camera Network

Abstract Face recognition in outdoor environment is a challenging task due to illumination changes, pose variations, and occlusions. In this chapter, we discuss several techniques for continuous tracking of faces acquired by an outdoor camera network as well as a face matching algorithm. Active camera networks are capable of reconfiguring the camera parameters to collaboratively capture the close-up views of face images. Robust face recognition methods can utilize compact representations extracted from multi-view videos. In the meantime, the constraints of consistent tracking of faces and the limitation of network resources should be satisfied. In this book chapter, we discuss several techniques for continuous tracking of faces acquired by a camera network as well as a face matching algorithm. We conclude this chapter with the discussion on the remaining challenges and emerging frameworks for face recognition in outdoor camera networks.

[1]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[2]  Amit K. Roy-Chowdhury,et al.  Collaborative Sensing in a Distributed PTZ Camera Network , 2012, IEEE Transactions on Image Processing.

[3]  Noah Snavely.  Photo Tourism : Exploring image collections in 3D , 2006 .

[4]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Jun-Cheng Chen,et al.  An End-to-End System for Unconstrained Face Verification with Deep Convolutional Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[6]  Abir Das,et al.  Consistent Re-identification in a Camera Network , 2014, ECCV.

[7]  Rama Chellappa,et al.  Face Association for Videos Using Conditional Random Fields and Max-Margin Markov Networks , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Kuk-Jin Yoon,et al.  Robust Online Multi-object Tracking Based on Tracklet Confidence and Online Discriminative Appearance Learning , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Hugo Proença,et al.  Acquiring high-resolution face images in outdoor environments: A master-slave calibration algorithm , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[11]  Bir Bhanu,et al.  Dynamic Bayesian Network for Unconstrained Face Recognition in Surveillance Camera Networks , 2013, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[12]  Gang Hua,et al.  Hierarchical-PEP model for real-world face recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Rama Chellappa,et al.  Face Association across Unconstrained Video Frames Using Conditional Random Fields , 2012, ECCV.

[14]  Gang Hua,et al.  Probabilistic Elastic Matching for Pose Variant Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Amit K. Roy-Chowdhury,et al.  Opportunistic sensing in a distributed PTZ camera network , 2012, 2012 Sixth International Conference on Distributed Smart Cameras (ICDSC).

[16]  Ramakant Nevatia,et al.  Robust multi-pose face tracking by multi-stage tracklet association , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[17]  Amit K. Roy-Chowdhury,et al.  Determining Topology in a Distributed Camera Network , 2007, 2007 IEEE International Conference on Image Processing.

[18]  Jongmoo Choi,et al.  Identifying Noncooperative Subjects at a Distance Using Face Images and Inferred Three-Dimensional Face Models , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[19]  Arun Ross,et al.  Collaborative Face Recognition Using a Network of Embedded Cameras , 2011 .

[20]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[21]  Xilin Chen,et al.  Calibration of a hybrid camera network , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Amit K. Roy-Chowdhury,et al.  Distributed multi-target tracking in a self-configuring camera network , 2009, CVPR.

[23]  Gérard G. Medioni,et al.  Real time tracking using an active pan-tilt-zoom network camera , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  R. Olfati-Saber,et al.  Distributed tracking in sensor networks with limited sensing range , 2008, 2008 American Control Conference.

[26]  Robert Sabourin,et al.  Adaptive ensembles for face recognition in changing video surveillance environments , 2014, Inf. Sci..

[27]  Jean-Marc Odobez,et al.  Track Creation and Deletion Framework for Long-Term Online Multiface Tracking , 2013, IEEE Transactions on Image Processing.

[28]  Shengcai Liao,et al.  Partial Face Recognition: Alignment-Free Approach , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Gérard G. Medioni,et al.  High resolution face sequences from a PTZ network camera , 2011, Face and Gesture 2011.

[30]  David J. Kriegman,et al.  Visual tracking and recognition using probabilistic appearance manifolds , 2005, Comput. Vis. Image Underst..

[31]  Rama Chellappa,et al.  Remote Identification of Faces , 2014 .

[32]  Gérard G. Medioni,et al.  Towards a practical PTZ face detection and tracking system , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[33]  Liyan Zhang,et al.  Context-based person identification framework for smart video surveillance , 2013, Machine Vision and Applications.

[34]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[35]  Jian Zhao,et al.  Optimal Camera Network Configurations for Visual Tagging , 2008, IEEE Journal of Selected Topics in Signal Processing.

[36]  Anderson Rocha,et al.  Toward Open Set Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[38]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Ziyan Wu,et al.  Keeping a Pan-Tilt-Zoom Camera Calibrated , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  João Paulo Costeira,et al.  3D face recognition from multiple images: A shape-from-motion approach , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[41]  Jian Sun,et al.  Bayesian Face Revisited: A Joint Formulation , 2012, ECCV.

[42]  Rama Chellappa,et al.  Dictionary-Based Face Recognition from Video , 2012, ECCV.

[43]  Ming-Hsuan Yang,et al.  Bayesian Multi-object Tracking Using Motion Context from Multiple Objects , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[44]  Gérard G. Medioni,et al.  Persistent People Tracking and Face Capture over a Wide Area , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[45]  Luc Van Gool,et al.  Robust tracking-by-detection using a detector confidence particle filter , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[46]  Gang Hua,et al.  Eigen-PEP for Video Face Recognition , 2014, ACCV.

[47]  Andrew Zisserman,et al.  Fisher Vector Faces in the Wild , 2013, BMVC.

[48]  Bernhard Rinner,et al.  Dynamic Reconfiguration in Camera Networks: A Short Survey , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[49]  Rama Chellappa,et al.  Robust Face Recognition From Multi-View Videos , 2014, IEEE Transactions on Image Processing.

[50]  Sudeep Sarkar,et al.  Outdoor recognition at a distance by fusing gait and face , 2007, Image Vis. Comput..

[51]  Venkatesh Saligrama,et al.  Video anomaly detection based on local statistical aggregates , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Rama Chellappa,et al.  Face recognition from video: a CONDENSATION approach , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[53]  Amit K. Roy-Chowdhury,et al.  Distributed Constrained Optimization for Bayesian Opportunistic Visual Sensing , 2014, IEEE Transactions on Control Systems Technology.

[54]  Sander Stuijk,et al.  Online multi-face detection and tracking using detector confidence and structured SVMs , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[55]  Harry Wechsler,et al.  Open set face recognition using transduction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Gérard G. Medioni,et al.  Exploring context information for inter-camera multiple target tracking , 2014, IEEE Winter Conference on Applications of Computer Vision.

[57]  Qiang Ji,et al.  Simultaneous Clustering and Tracklet Linking for Multi-face Tracking in Videos , 2013, 2013 IEEE International Conference on Computer Vision.

[58]  Mubarak Shah,et al.  A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint , 2006, ECCV.

[59]  Touradj Ebrahimi,et al.  Privacy in mini-drone based video surveillance , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[60]  François Brémond,et al.  Group behavior recognition with multiple cameras , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[61]  Liang Lin,et al.  I2T: Image Parsing to Text Description , 2010, Proceedings of the IEEE.

[62]  Alan Yuille,et al.  Active Vision , 2014, Computer Vision, A Reference Guide.

[63]  Alessio Del Bue,et al.  Social interaction discovery by statistical analysis of F-formations , 2011, BMVC.

[64]  Bin Zhang,et al.  Face Recognition in Mobile Wireless Sensor Networks , 2013, Int. J. Distributed Sens. Networks.