A Scalable Architecture for Operational FMV Exploitation

A scalable open systems and standards derived software ecosystem is described for computer vision analytics (CVA) assisted exploitation of full motion video (FMV). The ecosystem, referred to as the Advanced Video Activity Analytics (AVAA), has two instantiations, one for size, weight, and power (SWAP) constrained conditions, and the other for large to massive cloud based configurations. The architecture is designed to meet operational analyst requirements to increase their productivity and accuracy for exploiting FMV using local cluster or scalable cloudbased computing resources. CVAs are encapsulated within a software plug-in architecture and FMV processing pipelines are constructed by combining these plug-ins to accomplish analytical tasks and manage provenance of processing history. An example pipeline for real-time motion detection and moving object characterization using the flux tensor approach is presented. An example video ingest experiment is described. Quantitative and qualitative methods for human factors engineering (HFE) assessment to evaluate cognitive loads for alternative work flow design choices are discussed. This HFE process is used for validating that an AVAA system instantiation with candidate workflow pipelines meets CVA assisted FMV exploitation operational goals for specific analyst workflows. AVAA offers a new framework for video understanding at scale for large enterprise applications in the government and commercial sectors.

[1]  Chris Berka,et al.  Real-Time Analysis of EEG Indexes of Alertness, Cognition, and Memory Acquired With a Wireless EEG Headset , 2004, Int. J. Hum. Comput. Interact..

[2]  G. Seetharaman,et al.  Wide-Area Persistent Airborne Video: Architecture and Challenges , 2011 .

[3]  Guna Seetharaman,et al.  Efficient feature extraction and likelihood fusion for vehicle tracking in low frame rate airborne video , 2010, 2010 13th International Conference on Information Fusion.

[4]  Kannappan Palaniappan Network-based Visualization Using the Distributed Image SpreadSheet (DISS) , 2001 .

[5]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[6]  Lindsay D. Millard,et al.  Motion Imagery Processing and Exploitation (Mipe) , 2013 .

[7]  Guna Seetharaman,et al.  MULTICORE ENERGY EFFICIENT FLUX TENSOR FOR VIDEO ANALYSIS , 2010 .

[8]  Rui Wang,et al.  Static and Moving Object Detection Using Flux Tensor with Split Gaussian Models , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[9]  H. Widdel Operational Problems in Analysing Eye Movements , 1984 .

[10]  Kannappan Palaniappan,et al.  Interactive target tracking for persistent wide-area surveillance , 2012 .

[11]  Volume Assp,et al.  ACOUSTICS. SPEECH. AND SIGNAL PROCESSING , 1983 .

[12]  Chris Berka,et al.  Drowsiness/alertness algorithm development and validation using synchronized EEG and cognitive performance to individualize a generalized model , 2011, Biological Psychology.

[13]  Kevin K. Green,et al.  Near real-time, on-the-move software PED using VPEF , 2015, Defense + Security Symposium.

[14]  Anthony J. Ries,et al.  Advanced Video Activity Analytics (AVAA): Human Factors Evaluation , 2015 .

[15]  Guna Seetharaman,et al.  Parallel flux tensor analysis for efficient moving object detection , 2011, 14th International Conference on Information Fusion.

[16]  James Lebak,et al.  VSIPL: an object-based open standard API for vector, signal, and image processing , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[17]  Guna Seetharaman,et al.  Flux Tensor Constrained Geodesic Active Contours with Sensor Fusion for Persistent Object Tracking , 2007, J. Multim..

[18]  Darren R Gitelman,et al.  ILAB: A program for postexperimental eye movement analysis , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[19]  Guna Seetharaman,et al.  Persistent target tracking using likelihood fusion in wide-area and full motion video sequences , 2012, 2012 15th International Conference on Information Fusion.

[20]  Guna Seetharaman,et al.  Geodesic Active Contour Based Fusion of Visible and Infrared Video for Persistent Object Tracking , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).