Video Analytics for Force Protection

For troop and military installation protection, modern computer vision methods must be harnessed to enable a comprehensive approach to contextual awareness. In this chapter we present a collection of intelligent video technologies currently under development at the General Electric Global Research Center, which can be applied to this challenging problem. These technologies include: aerial analysis for object detection and tracking, site-wide tracking from networks of fixed video cameras, person detection from moving platforms, biometrics at a distance and facial analysis for the purposes of inferring intent. We hypothesize that a robust approach to troop protection will require the synthesis of all of these technologies into a comprehensive system of systems.

[1]  Walterio W. Mayol-Cuevas,et al.  18th British Machine Vision Conference , 2007 .

[2]  Xiaoming Liu,et al.  Discriminative Face Alignment , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Xiaoming Liu,et al.  Video-based face model fitting using Adaptive Active Appearance Model , 2010, Image Vis. Comput..

[4]  Xiaoming Liu,et al.  Generic Face Alignment using Boosted Appearance Model , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Xiaoming Liu,et al.  Automatic facial landmark labeling with minimal supervision , 2009, CVPR.

[6]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Qiang Ji,et al.  Facial Action Unit Recognition by Exploiting Their Dynamic and Semantic Relationships , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  A. G. Amitha Perera,et al.  Evaluation of Algorithms for Tracking Multiple Objects in Video , 2006, 35th IEEE Applied Imagery and Pattern Recognition Workshop (AIPR'06).

[9]  Qiang Ji,et al.  A Unified Probabilistic Framework for Facial Activity Modeling and Understanding , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Peter H. Tu,et al.  On optimizing subspaces for face recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Christopher R. Greco,et al.  Objective performance evaluation of a moving object super-resolution system , 2009, 2009 IEEE Applied Imagery Pattern Recognition Workshop (AIPR 2009).

[13]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[14]  Xiaoming Liu,et al.  An intelligent video framework for homeland protection , 2007, SPIE Defense + Commercial Sensing.

[15]  Yi Yao,et al.  Boosting for transfer learning with multiple sources , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  A. G. Amitha Perera,et al.  A unified framework for tracking through occlusions and across sensor gaps , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  A. G. Amitha Perera,et al.  Multi-Object Tracking Through Simultaneous Long Occlusions and Split-Merge Conditions , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Qiang Ji,et al.  Modeling and exploiting the spatio-temporal facial action dependencies for robust spontaneous facial expression recognition , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[19]  Ting Yu,et al.  Monitoring, recognizing and discovering social networks , 2009, CVPR.

[20]  Henry Schneiderman,et al.  Feature-centric evaluation for efficient cascaded object detection , 2004, CVPR 2004.

[21]  John Daugman.  How iris recognition works , 2004 .

[22]  Yi Yao,et al.  Region moments: Fast invariant descriptors for detecting small image structures , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Richard I. Hartley,et al.  Person Reidentification Using Spatiotemporal Appearance , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  Qiang Ji,et al.  Inferring Facial Action Units with Causal Relations , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[25]  Libor Masek,et al.  Recognition of Human Iris Patterns for Biometric Identification , 2003 .

[26]  John Daugman,et al.  Probing the Uniqueness and Randomness of IrisCodes: Results From 200 Billion Iris Pair Comparisons , 2006, Proceedings of the IEEE.

[27]  A. G. Amitha Perera,et al.  Moving Object Segmentation using Scene Understanding , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[28]  F.W. Wheeler,et al.  Stand-off Iris Recognition System , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[29]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[30]  Peter H. Tu,et al.  Improved Face Model Fitting on Video Sequences , 2007, BMVC.

[31]  Gregory D. Hager,et al.  Joint probabilistic techniques for tracking multi-part objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[32]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[33]  P. Tu.  Surveillance video analytics for large camera networks , 2007 .

[34]  Xiaogang Wang,et al.  Shape and Appearance Context Modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[35]  Hao Wu,et al.  Face alignment via boosted ranking model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Xiaoming Liu,et al.  Multi-Frame Image Restoration for Face Recognition , 2007 .

[37]  Qiang Ji,et al.  A Unified Probabilistic Framework for Spontaneous Facial Action Modeling and Understanding , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Xiaoming Liu,et al.  Multi-Frame Super-Resolution for Face Recognition , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[39]  Samuel S. Blackman,et al.  Design and Analysis of Modern Tracking Systems , 1999 .

[40]  Ting Yu,et al.  Collaborative Real-Time Control of Active Cameras in Large Scale Surveillance Systems , 2008 .

[41]  Qiang Ji,et al.  Active Image Labeling and Its Application to Facial Action Labeling , 2008, ECCV.

[42]  Xiaoming Liu,et al.  Simultaneous alignment and clustering for an image ensemble , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[43]  Ting Yu,et al.  Boosted deformable model for human body alignment , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Peter H. Tu,et al.  Automatic Face Recognition from Skeletal Remains , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Henry Schneiderman,et al.  Learning a restricted Bayesian network for object detection , 2004, CVPR 2004.

[46]  Frederick W. Wheeler,et al.  Moving Vehicle Registration and Super-Resolution , 2007, 36th Applied Imagery Pattern Recognition Workshop (aipr 2007).

[47]  Peter H. Tu,et al.  Face Model Fitting on Low Resolution Images , 2006, BMVC.

[48]  Ting Yu,et al.  What are customers looking at? , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.