A System for the Generation of Synthetic Wide Area Aerial Surveillance Imagery

The development, benchmarking and validation of aerial Persistent Surveillance (PS) algorithms requires access to specialist Wide Area Aerial Surveillance (WAAS) datasets. Such datasets are difficult to obtain and are often extremely large both in spatial resolution and temporal duration. This paper outlines an approach to the simulation of complex urban environments and demonstrates the viability of using this approach for the generation of simulated sensor data, corresponding to the use of wide area imaging systems for surveillance and reconnaissance applications. This provides a cost-effective method to generate datasets for vehicle tracking algorithms and anomaly detection methods. The system fuses the Simulation of Urban Mobility (SUMO) traffic simulator with a MATLAB controller and an image generator to create scenes containing uninterrupted door-to-door journeys across large areas of the urban environment. This `pattern-of-life' approach provides three-dimensional visual information with natural movement and traffic flows. This can then be used to provide simulated sensor measurements (e.g. visual band and infrared video imagery) and automatic access to ground-truth data for the evaluation of multi-target tracking systems.

[1]  Aaron F. Bobick,et al.  Learning and detecting coordinated multi-entity activities from persistent surveillance , 2013, Defense, Security, and Sensing.

[2]  Daniel Krajzewicz,et al.  SUMO (Simulation of Urban MObility) - an open-source traffic simulation , 2002 .

[3]  Tomas Akenine-Möller,et al.  Fast, Minimum Storage Ray-Triangle Intersection , 1997, J. Graphics, GPU, & Game Tools.

[4]  Jun Rekimoto,et al.  LifeTag: WiFi-Based Continuous Location Logging for Life Pattern Analysis , 2007, LoCA.

[5]  Daniel Krajzewicz,et al.  SUMO - Simulation of Urban MObility An Overview , 2011 .

[6]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[7]  John A. Antoniades,et al.  Autonomous real-time ground ubiquitous surveillance-imaging system (ARGUS-IS) , 2008, SPIE Defense + Commercial Sensing.

[8]  Vinh Tran,et al.  PerSEval phase I: development of a 3D urban terrain model for evaluation of persistent surveillance sensors and video-based tracking algorithms , 2010, Defense + Commercial Sensing.

[9]  Freeman D. Shepherd,et al.  Characterizing IR FPA nonuniformity and IR camera spatial noise , 1996 .

[10]  Marco Fiore,et al.  Generation and Analysis of a Large-Scale Urban Vehicular Mobility Dataset , 2014, IEEE Transactions on Mobile Computing.

[11]  Wentong Cai,et al.  SEMSim Cloud Service: Large-scale urban systems simulation in the cloud , 2015, Simul. Model. Pract. Theory.

[12]  Daniel Krajzewicz,et al.  Simulation of modern Traffic Lights Control Systems using the open source Traffic Simulation SUMO , 2005 .

[13]  Zilu Liang,et al.  Real-time urban traffic amount prediction models for dynamic route guidance systems , 2014, EURASIP Journal on Wireless Communications and Networking.

[14]  Mark de Berg,et al.  On levels of detail in terrains , 1995, SCG '95.

[15]  Maxim Raya,et al.  TraCI: an interface for coupling road traffic and network simulators , 2008, CNS '08.

[16]  Peter Shirley,et al.  An Efficient and Robust Ray-Box Intersection Algorithm , 2005, J. Graph. Tools.

[17]  Todd Rovito,et al.  Camera models for the wright patterson air force base (WPAFB) 2009 wide-area motion imagery (WAMI) data set , 2015, IEEE Aerospace and Electronic Systems Magazine.

[18]  Lance Menthe,et al.  The Future of Air Force Motion Imagery Exploitation: Lessons from the Commercial World , 2012 .

[19]  R. D. Bretherton SCOOT URBAN TRAFFIC CONTROL SYSTEM—PHILOSOPHY AND EVALUATION11Crown Copyright. The views expressed in this Paper are not necessarily those of the Department of Transport. Extracts from the text may be reproduced, except for commercial purposes, provided the source is acknowledged. , 1990 .

[20]  Stefan Jakubek,et al.  Macroscopic traffic model for large scale urban traffic network design , 2018, Simul. Model. Pract. Theory.

[21]  Antonio Ramírez-Treviño,et al.  A modeling framework for urban traffic systems microscopic simulation , 2010, Simul. Model. Pract. Theory.

[22]  Jian Sun,et al.  Development and application of an integrated traffic simulation and multi-driving simulators , 2015, Simul. Model. Pract. Theory.

[23]  Alain Gibaud,et al.  Deployment of a fully distributed system for improving urban traffic flows: A simulation-based performance analysis , 2013, Simul. Model. Pract. Theory.

[24]  Nick Hounsell,et al.  SCOOT, A TRAFFIC DATABASE , 1990 .

[25]  Jairo Espinosa,et al.  TraCI4Matlab: Enabling the Integration of the SUMO Road Traffic Simulator and Matlab® Through a Software Re-engineering Process , 2015 .

[26]  R. D. Bretherton,et al.  SCOOT URBAN TRAFFIC CONTROL SYSTEM: PHILOSOPHY AND EVALUATION , 1990 .

[27]  R. Driggers,et al.  Introduction to Infrared and Electro-Optical Systems , 1998 .

[28]  Michael Schreckenberg,et al.  A verifiable simulation model for real-world microscopic traffic simulations , 2014, Simul. Model. Pract. Theory.

[29]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[30]  Martin Treiber,et al.  Traffic Flow Dynamics: Data, Models and Simulation , 2012 .

[31]  Richard G Baraniuk,et al.  More Is Less: Signal Processing and the Data Deluge , 2011, Science.

[32]  Kang-Tsung Chang,et al.  Introduction to Geographic Information Systems , 2001 .

[33]  Dirk Helbing,et al.  MASTER: macroscopic traffic simulation based on a gas-kinetic, non-local traffic model , 2001 .

[34]  Jian Sun,et al.  Statistics of Patch Offsets for Image Completion , 2012, ECCV.

[35]  Sharath Pankanti,et al.  Blinkering Surveillance: Enabling Video Privacy through Computer Vision , 2004 .

[36]  Ajith Abraham,et al.  A Neural Network Model for Road Traffic Flow Estimation , 2015, NaBIC.

[37]  Kay W. Axhausen,et al.  The Multi-Agent Transport Simulation , 2016 .

[38]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[39]  Anna Corinna Cagliano,et al.  Current trends in Smart City initiatives: some stylised facts , 2014 .

[40]  Pawel Gburzynski,et al.  A realistic outdoor urban pedestrian mobility model , 2012, Simul. Model. Pract. Theory.

[41]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[42]  J. Mixter Fast , 2012 .

[43]  Stefan Krauss,et al.  MICROSCOPIC MODELING OF TRAFFIC FLOW: INVESTIGATION OF COLLISION FREE VEHICLE DYNAMICS. , 1998 .