Military Simulation Big Data: Background, State of the Art, and Challenges

Big data technology has undergone rapid development and attained great success in the business field. Military simulation (MS) is another application domain producing massive datasets created by high-resolution models and large-scale simulations. It is used to study complicated problems such as weapon systems acquisition, combat analysis, and military training. This paper firstly reviewed several large-scale military simulations producing big data (MS big data) for a variety of usages and summarized the main characteristics of result data. Then we looked at the technical details involving the generation, collection, processing, and analysis of MS big data. Two frameworks were also surveyed to trace the development of the underlying software platform. Finally, we identified some key challenges and proposed a framework as a basis for future work. This framework considered both the simulation and big data management at the same time based on layered and service oriented architectures. The objective of this review is to help interested researchers learn the key points of MS big data and provide references for tackling the big data problem and performing further research.

[1]  Albert Burger,et al.  Advanced distributed simulation: a review of developments and their implication for data collection and analysis , 2000, Simul. Pract. Theory.

[2]  Thomas W. Lucas,et al.  Exploring the world of agent-based simulations: simple models, complex analyses , 2002, Proceedings of the Winter Simulation Conference.

[3]  Dan M. Davis,et al.  Distributed and Interactive Simulations Operating at Large Scale for Transcontinental Expeimentation , 2010, 2010 IEEE/ACM 14th International Symposium on Distributed Simulation and Real Time Applications.

[4]  Ian Gorton,et al.  The Changing Paradigm of Data-Intensive Computing , 2009, Computer.

[5]  Mansaf Alam,et al.  Recent Developments in Cloud Based Systems: State of Art , 2015, ArXiv.

[6]  ChanGon Yoo,et al.  Autonomous intelligent simulation model based on CGF for military training and analysis , 2011 .

[7]  Dan M. Davis,et al.  Data Fusion of Geographically Dispersed Information: Experience with the Scalable Data Grid , 2011 .

[8]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[9]  Mark Hoogendoorn,et al.  A Decision Making Model Based on Damasio's Somatic Marker Hypothesis , 1994 .

[10]  K. Roe,et al.  Space Surveillance Network and Analysis Model (SSNAM) Performance Improvements , 2007, 2007 DoD High Performance Computing Modernization Program Users Group Conference.

[11]  James E. Coolahan Modeling and simulation at APL , 2003 .

[12]  Liang Han,et al.  Experimental study on fighters behaviors mining , 2011, Expert Syst. Appl..

[13]  Guanghong Gong,et al.  A Fully Distributed Collection Technology for Mass Simulation Data , 2013, 2013 International Conference on Computational and Information Sciences.

[14]  Eric Heilman,et al.  FROM SIMULATION TO INSIGHTS: EXPERIMENTS IN THE USE OF A MULTI-CRITERIAL VIEWER TO DEVELOP UNDERSTANDING OF THE COA SPACE , 2003 .

[15]  Xiao Song,et al.  Real-time load balancing scheduling algorithm for periodic simulation models , 2015, Simul. Model. Pract. Theory.

[16]  Mark Hoogendoorn,et al.  An Integrated Agent Model Addressing Situation Awareness and Functional State in Decision Making , 2011, PRIMA.

[17]  Lizhe Wang,et al.  Advances in data-intensive modelling and simulation , 2014, Future Gener. Comput. Syst..

[18]  Xindong Wu,et al.  Data mining with big data , 2014, IEEE Transactions on Knowledge and Data Engineering.

[19]  Jason H. Li,et al.  Tactical big data analytics: challenges, use cases, and solutions , 2014, PERV.

[20]  Yunfei Yin Online Data Mining and Control Approach to Formation Flying , 2011 .

[21]  Richard A. McCourt,et al.  Enhanced network modeling in ABSNEC , 2010, SummerSim.

[22]  Ihsan Sabuncuoglu,et al.  A design of experiments approach to military Deployment Planning Problem , 2008, 2008 Winter Simulation Conference.

[23]  Sung-Do Chi,et al.  FAMES: fully agent-based modeling & emergent simulation , 2009, SpringSim '09.

[24]  Eric Heilman,et al.  Mining simulation data for insights about a decision space: application to an urban combat COA , 2004, SPIE Defense + Commercial Sensing.

[25]  Sameer Singh,et al.  Approaches to Multisensor Data Fusion in Target Tracking: A Survey , 2006, IEEE Transactions on Knowledge and Data Engineering.

[26]  Karl Aberer,et al.  An Evaluation of Model-Based Approaches to Sensor Data Compression , 2013, IEEE Transactions on Knowledge and Data Engineering.

[27]  Simon J. E. Taylor,et al.  Modeling and simulation grand challenges: An OR/MS perspective , 2013, 2013 Winter Simulations Conference (WSC).

[28]  Azzedine Boukerche,et al.  Dynamic balancing of communication and computation load for HLA-based simulations on large-scale distributed systems , 2011, J. Parallel Distributed Comput..

[29]  Song Han,et al.  On Co-Scheduling of Update and Control Transactions in Real-Time Sensing and Control Systems: Algorithms, Analysis, and Performance , 2013, IEEE Transactions on Knowledge and Data Engineering.

[30]  Gary E. Horne,et al.  Data Farming in support of NATO operations - methodology and proof-of-concept , 2014, Proceedings of the Winter Simulation Conference 2014.

[31]  Maojun Zhang,et al.  Framework of wargame CGF system based on multi-agent , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[32]  Erdal Cayirci,et al.  Configuration schemes for modeling and simulation as a service federation , 2013, Simul..

[33]  Bernd Möller,et al.  Scalable and Embeddable Data Logging for Live, Virtual and Constructive Simulation : HLA, Link I6, DIS and more , 2011 .

[34]  Gene Wagenbreth,et al.  Data Analysis for Massively Distributed Simulations , 2009 .

[35]  Lei Feng,et al.  IBMSE: An Integrated Behavior Modeling and Simulation Environment , 2010, 2010 Second International Conference on Computer Modeling and Simulation.

[36]  Phil Hallenbeck,et al.  Data and Event Visualization , 2009 .

[37]  Mike Barnes,et al.  One Semi-Automated Forces (OneSAF): Capabilities, Architecture, and Processes , 2008 .

[38]  Robbert-Jan Merk,et al.  A Computational Model on Surprise and Its Effects on Agent Behaviour in Simulated Environments , 2010, PAAMS.

[39]  Manish Parashar Big data challenges in simulation-based science , 2014, DIDC '14.

[40]  Eric Heilman,et al.  Battle Command Metric Exploration in a Simulated Combat Environment , 2005 .

[41]  Bartosz Kryza,et al.  Massively Scalable Platform for Data Farming Supporting Heterogeneous Infrastructure , 2013, CLOUD 2013.

[42]  Justin L. Ross A comparative study of simulation software for modeling stability operations , 2012 .

[43]  K. van den Bosch,et al.  Modeling Cultural Behavior for Military Virtual Training , 2011 .

[44]  Jan Joris Roessingh,et al.  Modelling CGFs for tactical air-to-air combat trainingMotivation-based behaviour and Machine Learning in a common architecture , 2011 .

[45]  Wei Xue,et al.  A case study of large-scale parallel I/O analysis and optimization for numerical weather prediction system , 2014, Future Gener. Comput. Syst..

[46]  Jens Hartmann,et al.  Data Farming in Support of NATO , 2014 .

[47]  Jianping Zhang,et al.  Architecting a knowledge discovery engine for military commanders utilizing massive runs of simulations , 2003, KDD '03.

[48]  Raymond R. Hill,et al.  The art and science of live, virtual, and constructive simulation for test and analysis , 2014 .

[49]  Tony Hey,et al.  The Fourth Paradigm: Data-Intensive Scientific Discovery , 2009 .

[50]  Liu Gang High-performance Simulation Computer for Large-scale System-of-Systems Simulation , 2011 .

[51]  Jerzy W. Bala,et al.  Mining characteristic rules for understanding simulation data , 2002, 14th IEEE International Conference on Tools with Artificial Intelligence, 2002. (ICTAI 2002). Proceedings..

[52]  Mauro Iacono,et al.  Exploiting mean field analysis to model performances of big data architectures , 2014, Future Gener. Comput. Syst..

[53]  Bernd Möller,et al.  Toward a Data Logging Data Interchange Format: Use Cases and Requirements , 2011 .

[54]  Jun Pan,et al.  Decision-making and planning of computer generated forces , 2012, 2012 IEEE International Conference on Computer Science and Automation Engineering (CSAE).

[55]  Alexander B Anastasiou Modeling Urban Warfare: Joint Semi-Automated Forces in Urban Resolve , 2012 .

[56]  Albert Y. Zomaya,et al.  Remote sensing big data computing: Challenges and opportunities , 2015, Future Gener. Comput. Syst..

[57]  Yonggang Wen,et al.  Toward Scalable Systems for Big Data Analytics: A Technology Tutorial , 2014, IEEE Access.

[58]  Erdal Cayirci,et al.  Modeling and simulation as a cloud service: A survey , 2013, 2013 Winter Simulations Conference (WSC).

[59]  XiaoFeng Hu,et al.  Simulation in the big data era——review of new ideas and new theories in the 81st Academic Salon of China Association for Science and Technology , 2014 .

[60]  Bernard P. Zeigler,et al.  Service-Oriented Model Engineering and Simulation for System of Systems Engineering , 2015 .

[61]  Xiao Song,et al.  A Load Balancing Scheme Using Federate Migration Based on Virtual Machines for Cloud Simulations , 2015 .