Research Challenges in Modeling and Simulation for Engineering Complex Systems

ion layer Function Model layer The code of a particular model (or component) Model framework layer Collection of model classes, components, and libraries for a single application area, such as network simulation or PDE solution Simulator layer Provides a single paradigm for simulation time, space, naming, parallelism, and synchronization for use in one component of a (possibly) federated simulation Component federation layer Provides interface code to allow independently created submodels, possibly written in different languages, to communicate, synchronize, and interoperate in various ways to become a single federated model Load management layer Within one parallel model execution, measures resource utilization (time, energy, bandwidth, memory) at runtime and dynamically manages or migrates loads to optimize some performance metric Ensemble layer Runs many instances of the same model as an ensemble in a single large job, for such purposes as parameter sensitivity studies, parameter optimization, variance estimation. Handles scheduling, failures, accounting, and time estimates, allocates file directories, decides on ensemble termination, etc. Operating system /job scheduler layer Runs independent jobs in parallel. Provides processes, interprocess communication, I/O, files systems, etc. 62 C. Carothers et al.

[1]  Leon F. McGinnis,et al.  Toward on-demand wafer fab simulation using formal structure & behavior models , 2008, 2008 Winter Simulation Conference.

[2]  ปิยดา สมบัติวัฒนา Behavioral Game Theory: Experiments in Strategic Interaction , 2013 .

[3]  Ernest H. Page,et al.  Toward a Family of Maturity Models for the Simulation Interconnection Problem , 2004 .

[4]  Morris Sloman,et al.  A survey of trust in internet applications , 2000, IEEE Communications Surveys & Tutorials.

[5]  Hanifa Boucheneb,et al.  A formalization of global simulation models for continuous/discrete systems , 2007, SCSC.

[6]  Mikel D. Petty,et al.  Software frameworks for model composition , 2014 .

[7]  Han Reichgelt Knowledge representation - an AI perspective , 1991, Tutorial monographs in cognitive science.

[8]  Christopher D. Carothers,et al.  Warp speed: executing time warp on 1,966,080 cores , 2013, SIGSIM-PADS.

[9]  DONALD G. SAARI,et al.  ARE PART WISE COMPARISONS RELIABLE ? , 2003 .

[10]  Sez Atamturktur,et al.  Mitigating Error and Uncertainty in Partitioned Analysis: A Review of Verification, Calibration and Validation Methods for Coupled Simulations , 2017 .

[11]  Mikel D. Petty,et al.  Validity of Models and Classes of Models in Semantic Composability , 2003 .

[12]  Osman Balci,et al.  Verification, validation, and accreditation , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[13]  Ernest H. Page,et al.  Observations on the complexity of composable simulation , 1999, WSC '99.

[14]  Bernard P. Zeigler,et al.  Guide to Modeling and Simulation of Systems of Systems , 2012, SpringerBriefs in Computer Science.

[15]  Apostolos Dollas,et al.  Big Data Processing with FPGA Supercomputers: Opportunities and Challenges , 2014, 2014 IEEE Computer Society Annual Symposium on VLSI.

[16]  Osman Balci,et al.  Web-based random variate generation for stochastic simulations , 2005, Int. J. Simul. Process. Model..

[17]  Wei Chen,et al.  An Approach to Decision-Based Design With Discrete Choice Analysis for Demand Modeling , 2003 .

[18]  Madhav V. Marathe,et al.  Understanding Large-Scale Social and Infrastructure Networks: A Simulation-Based Approach , 2004 .

[19]  Colin Camerer,et al.  Neuroeconomics: How Neuroscience Can Inform Economics , 2005 .

[20]  Hans Vangheluwe,et al.  Domain-specific engineering of domain-specific languages , 2010, DSM '10.

[21]  Dov Dori,et al.  Systems Modeling Languages: OPM Versus SysML , 2007, 2007 International Conference on Systems Engineering and Modeling.

[22]  Louis Woods FPGA-enhanced data processing systems , 2014 .

[23]  Daniela Hincu,et al.  INTERDEPENDENCY BETWEEN SIMULATION MODEL DEVELOPMENT AND KNOWLEDGE MANAGEMENT , 2009 .

[24]  Osman Balci,et al.  Verification, Validation, and Testing , 2007 .

[25]  Kenneth D. Forbus Handbook of Knowledge Representation Edited Qualitative Modeling , 2022 .

[26]  Leon F. McGinnis,et al.  Logistics systems modeling and simulation , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[27]  Conrad Bock,et al.  Reusing metamodels and notation with Diagram Definition , 2016, Software & Systems Modeling.

[28]  Sandeep Neema,et al.  Metamodeling Languages and Metaprogrammable Tools , 2007, Handbook of Real-Time and Embedded Systems.

[29]  Eric W. Weisel,et al.  A Decision-Theoretic Approach to Defining Use for Computer Simulation , 2012 .

[30]  Juan Manuel Fernández Peña,et al.  Unified Modeling Language Unified Modeling Language , 2006 .

[31]  Imran Mahmood,et al.  A Verification Framework for Component Based Modeling and Simulation : "Putting the pieces together" , 2023, ArXiv.

[32]  James D. Arthur,et al.  Expanding our horizons in verification, validation, and accreditation research and practice , 2002, Proceedings of the Winter Simulation Conference.

[33]  Samarth Swarup,et al.  Synthetic Information Environments for Policy Informatics : A Distributed Cognition Perspective , 2012 .

[34]  Gabor Karsai,et al.  Composition and cloning in modeling and meta-modeling , 2004, IEEE Transactions on Control Systems Technology.

[35]  Mark F. Horstemeyer,et al.  Multiscale Modeling: A Review , 2009 .

[36]  Samarth Swarup,et al.  Simulation Summarization: (Extended Abstract) , 2016, AAMAS.

[37]  Vipul Periwal,et al.  Software Infrastructure for Effective Communication and Reuse of Computational Models , 2006 .

[38]  Wayne Luk,et al.  FPGA-Based Smith-Waterman Algorithm: Analysis and Novel Design , 2011, ARC.

[39]  Alberto Sillitti,et al.  Selecting components in large COTS repositories , 2004, J. Syst. Softw..

[40]  Ivo Babuška,et al.  Predictive Computational Science: Computer Predictions in the Presence of Uncertainty , 2017 .

[41]  Leon F. McGinnis,et al.  Simulation model generation of discrete event logistics systems (DELS) using software design patterns , 2014, Proceedings of the Winter Simulation Conference 2014.

[42]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[43]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[44]  Leon F. McGinnis,et al.  A simple example of SysML-driven simulation , 2009, Proceedings of the 2009 Winter Simulation Conference (WSC).

[45]  Sandeep Neema,et al.  Specification of Cyber-Physical Components with Formal Semantics - Integration and Composition , 2013, MoDELS.

[46]  J. Carson Introduction to modeling and simulation , 2005, Proceedings of the Winter Simulation Conference, 2005..

[47]  Celso Leandro Palma,et al.  Handbook of simulation: principles, methodology, advances, applications, and practice , 2016 .

[48]  Curtis Blais,et al.  Discovery and Reuse of Modeling and Simulation Assets / Paper 10S-SIW-048 , 2009 .

[49]  Edward A. Fox,et al.  Simulation Tools for Producing Metadata Description Sets Covering Simulation-based Content Collections , 2011 .

[50]  Adelinde M. Uhrmacher,et al.  Automatic Runtime Adaptation for Component-Based Simulation Algorithms , 2015, TOMC.

[51]  Donald G. Saari,et al.  Aggregation and Multilevel Design for Systems: Finding Guidelines , 2010 .

[52]  Levent Yilmaz,et al.  A Conceptual Model for Reusable Simulations Within a Model-Simulator-Context Framework , 2004 .

[53]  Martin Gogolla,et al.  Object Constraint Language (OCL): A Definitive Guide , 2012, SFM.

[54]  Mikel D. Petty,et al.  A Formal Approach to Composability , 2004 .

[55]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[56]  Mikel D. Petty,et al.  Computational complexity of selecting components for composition , 2003 .

[57]  Eswaran Subrahmanian,et al.  Evaluating Reasoning Systems , 2006 .

[58]  Alexandre Chapoutot,et al.  An operational semantics for Simulink's simulation engine , 2012, LCTES 2012.

[59]  Stewart Robinson,et al.  Conceptual modeling for simulation , 2013, 2013 Winter Simulations Conference (WSC).

[60]  Samarth Swarup,et al.  Prescriptive Analytics Using Synthetic Information , 2014 .

[61]  Madhav V. Marathe,et al.  Modeling and simulation of large biological, information and socio-technical systems: an interaction based approach , 2006 .

[62]  Janos Sztipanovits,et al.  Formalizing the structural semantics of domain-specific modeling languages , 2009, Software & Systems Modeling.

[63]  Pieter J. Mosterman,et al.  Motivating Use Cases for the Globalization of DSLs , 2014, Globalizing Domain-Specific Languages.

[64]  L. Graham,et al.  Business Models to Advance the Reuse of Modeling and Simulation Resources , 2009 .

[65]  Jan Mendling,et al.  Business Process Model and Notation , 2012, Lecture Notes in Business Information Processing.

[66]  James D. Arthur,et al.  Achieving reusability and composability with a simulation conceptual model , 2011, J. Simulation.

[67]  Edward A. Fox,et al.  Data mapping framework in a digital library with computational epidemiology datasets , 2014, IEEE/ACM Joint Conference on Digital Libraries.

[68]  J. Brimson,et al.  Cost Management for Today’s Advanced Manufacturing , 1988 .

[69]  Christian M. Reidys,et al.  An Introduction to Sequential Dynamical Systems , 2007, Universitext.

[70]  Mark C. Paulk,et al.  Capability Maturity Model , 1991 .

[71]  Mikel D. Petty Verification and Validation , 2008 .

[72]  Conrad Bock,et al.  Ontological Behavior Modeling , 2011, J. Object Technol..

[73]  Roger S. Pressman,et al.  Software Engineering: A Practitioner's Approach , 1982 .

[74]  Gary McGraw,et al.  Software Security: Building Security In , 2006, 2006 17th International Symposium on Software Reliability Engineering.

[75]  Harry B. Hunt,et al.  Analysis Problems for Graphical Dynamical Systems: A Unified Approach Through Graph Predicates , 2015, AAMAS.

[76]  Hans-Gerhard Groß,et al.  Component-based software testing with UML , 2004 .

[77]  Andreas Tolk,et al.  Reference modelling in support of M&S—foundations and applications , 2013, J. Simulation.

[78]  Andreas Tolk,et al.  The Levels of Conceptual Interoperability Model , 2003 .

[79]  Vladan Devedzic,et al.  Petri net ontology , 2006, Knowl. Based Syst..

[80]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[81]  Frank Budinsky,et al.  Eclipse modeling framework : a developer's guide , 2004 .

[82]  Diego Calvanese,et al.  Relationships with other Formalisms , 2003, Description Logic Handbook.

[83]  Rony Flatscher Metamodeling in EIA/CDIF---meta-metamodel and metamodels , 2002, TOMC.

[84]  Edward A. Fox,et al.  Improving simulation management systems through ontology generation and utilization , 2011, JCDL '11.

[85]  Samarth Swarup,et al.  Information Integration to Support Model-Based Policy Informatics. , 2011, The innovation journal : the public sector innovation journal.

[86]  Anna Freud,et al.  Introduction To Controlled Vocabularies Terminology For Art Architecture And Other Cultural Works , 2016 .

[87]  François E. Cellier,et al.  Continuous system modeling , 1991 .

[88]  Adelinde M. Uhrmacher,et al.  Syntax and Semantics of a Multi-Level Modeling Language , 2015, SIGSIM-PADS.

[89]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[90]  Richard M. Fujimoto,et al.  Research Challenges in Parallel and Distributed Simulation , 2016, ACM Trans. Model. Comput. Simul..

[91]  Leon F. McGinnis,et al.  System modeling in SYsML and system analysis in Arena , 2012, Proceedings Title: Proceedings of the 2012 Winter Simulation Conference (WSC).

[92]  Ram D. Sriram,et al.  A Vision of Cyber-Physical Cloud Computing for Smart Networked Systems , 2013 .

[93]  G. Nicolescu,et al.  Methodology for Efficient Design of Continuous / Discrete-Events Co-Simulation Tools , 2006 .

[94]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[95]  A Nebot,et al.  Mixed quantitative/qualitative modeling and simulation of the cardiovascular system. , 1998, Computer methods and programs in biomedicine.

[96]  Edward A. Fox,et al.  SimDL: a model ontology driven digital library for simulation systems , 2011, JCDL '11.

[97]  Robert R. Hoffman,et al.  Ontology Creation as a Sensemaking Activity , 2012, IEEE Intelligent Systems.

[98]  Osman Balci,et al.  Quality assessment, verification, and validation of modeling and simulation applications , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[99]  Karl Rihaczek,et al.  1. WHAT IS DATA MINING? , 2019, Data Mining for the Social Sciences.

[100]  Adelinde M. Uhrmacher,et al.  Multi-level modeling and simulation of cell biological systems with ML-Rules - A tutorial , 2014, Proceedings of the Winter Simulation Conference 2014.

[101]  J. Tinsley Oden,et al.  Selection, calibration, and validation of coarse-grained models of atomistic systems , 2015 .

[102]  Osman Balci,et al.  Conceptual modelling for designing large-scale simulations , 2007, J. Simulation.

[103]  Frederica Darema,et al.  Dynamic Data Driven Applications Systems: A New Paradigm for Application Simulations and Measurements , 2004, International Conference on Computational Science.

[104]  Pieter J. Mosterman,et al.  Grand challenges for modeling and simulation: simulation everywhere—from cyberinfrastructure to clouds to citizens , 2015, Simul..