Stochastic Hybrid Systems: Research Issues and Areas

STOCHASTIC HYBRID SYSTEMS: RESEARCH ISSUES AND AREAS Christos G. Cassandras and John Lygeros Introduction Modeling of Nondeterministic Hybrid Systems Modeling of Stochastic Hybrid Systems Overview of This Volume STOCHASTIC DIFFERENTIAL EQUATIONS ON HYBRID STATE SPACES Jaroslav Krystul, Henk A.P. Blom, and Arunabha Bagchi Introduction Semimartingales and Characteristics Semimartingale Strong Solution of SDE Stochastic Hybrid Processes as Solutions of SDE Instantaneous Hybrid Jumps at a Boundary Related SDE models on Hybrid State Spaces Markov and Strong Markov Properties Concluding Remarks COMPOSITIONAL MODELING OF STOCHASTIC HYBRID SYSTEMS Stefan Strubbe and Arjan van der Schaft Introduction Semantical Models Communicating PDPs Conclusions STOCHASTIC MODEL CHECKING Joost-Pieter Katoen Introduction The Discrete-Time Setting The Continuous-Time Setting Bisimulation and Simulation Relations Epilogue STOCHASTIC REACHABILITY: THEORY AND NUMERICAL APPROXIMATION Maria Prandini and Jianghai Hu Introduction Stochastic Hybrid System Model Reachability Problem Formulation Numerical Approximation Scheme Reachability Computations Possible Extensions Some Examples Conclusion STOCHASTIC FLOW SYSTEMS: MODELING AND SENSITIVITY ANALYSIS Christos G. Cassandras Introduction Modeling Stochastic Flow Systems Sample Paths of Stochastic Flow Systems Optimization Problems in Stochastic Flow Systems Infinitesimal Perturbation Analysis (IPA) Conclusions PERTURBATION ANALYSIS FOR STOCHASTIC FLOW SYSTEMS WITH FEEDBACK Yorai Wardi, George Riley, and Richelle Adams Introduction SFM with Flow Control Retransmission-Based Model Simulation Experiments Conclusions STOCHASTIC HYBRID MODELING OF ON-OFF TCP FLOWS Joao Hespanha Related Work A Stochastic Model for TCP Analysis of the TCP SHS Models Reduced-Order Models Conclusions STOCHASTIC HYBRID MODELING OF BIOCHEMICAL PROCESSES Panagiotis Kouretas, Konstantinos Koutroumpas, John Lygeros, and Zoi Lygerou Introduction Overview of PDMP Subtilin Production by B. subtilis DNA Replication in the Cell Cycle Concluding Remarks FREE FLIGHT COLLISION RISK ESTIMATION BY SEQUENTIAL MC SIMULATION Henk A.P. Blom, Jaroslav Krystul, G.J. (Bert) Bakker, Margriet B. Klompstra, and Bart Klein Obbink Introduction Sequential MC Estimation of Collision Risk Development of a Petri Net Model of Free Flight Simulated Scenarios and Collision Risk Estimates Concluding Remarks INDEX

[1]  Joost-Pieter Katoen,et al.  Safe On-The-Fly Steady-State Detection for Time-Bounded Reachability , 2005, Third International Conference on the Quantitative Evaluation of Systems - (QEST'06).

[2]  Joost-Pieter Katoen,et al.  A Markov reward model checker , 2005, Second International Conference on the Quantitative Evaluation of Systems (QEST'05).

[3]  Christel Baier,et al.  Comparative branching-time semantics for Markov chains , 2005, Inf. Comput..

[4]  Casey A. Volino,et al.  A First Course in Stochastic Models , 2005, Technometrics.

[5]  Marta Z. Kwiatkowska,et al.  Probabilistic symbolic model checking with PRISM: a hybrid approach , 2004, International Journal on Software Tools for Technology Transfer.

[6]  William H. Sanders,et al.  Optimal state-space lumping in Markov chains , 2003, Inf. Process. Lett..

[7]  Joost-Pieter Katoen,et al.  Model-checking large structured Markov chains , 2003, J. Log. Algebraic Methods Program..

[8]  M. Bravetti Revisiting Interactive Markov Chains , 2003, MTCS.

[9]  Joost-Pieter Katoen,et al.  Faster and Symbolic CTMC Model Checking , 2001, PAPM-PROBMIV.

[10]  Marta Z. Kwiatkowska,et al.  Automated Verification of a Randomized Distributed Consensus Protocol Using Cadence SMV and PRISM , 2001, CAV.

[11]  Christel Baier,et al.  On the Logical Characterisation of Performability Properties , 2000, ICALP.

[12]  Henk C. Tijms,et al.  A fast algorithm for the transient reward distribution in continuous-time Markov chains , 2000, Oper. Res. Lett..

[13]  William H. Sanders,et al.  A new methodology for calculating distributions of reward accumulated during a finite interval , 1996, Proceedings of Annual Symposium on Fault Tolerant Computing.

[14]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[15]  M. Puterman Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[16]  Kim G. Larsen,et al.  Bisimulation through Probabilistic Testing , 1991, Inf. Comput..

[17]  Kim Guldstrand Larsen,et al.  Specification and refinement of probabilistic processes , 1991, [1991] Proceedings Sixth Annual IEEE Symposium on Logic in Computer Science.

[18]  C. Jones,et al.  A probabilistic powerdomain of evaluations , 1989, [1989] Proceedings. Fourth Annual Symposium on Logic in Computer Science.

[19]  A. M. Turing,et al.  Checking a large routine , 1989 .

[20]  Mihalis Yannakakis,et al.  Verifying temporal properties of finite-state probabilistic programs , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[21]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[22]  Moshe Y. Vardi Automatic verification of probabilistic concurrent finite state programs , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[23]  Donald Gross,et al.  The Randomization Technique as a Modeling Tool and Solution Procedure for Transient Markov Processes , 1984, Oper. Res..

[24]  Joseph Sifakis,et al.  Specification and verification of concurrent systems in CESAR , 1982, Symposium on Programming.

[25]  Susan Owicki,et al.  An axiomatic proof technique for parallel programs I , 1976, Acta Informatica.