Probabilistic concurrent game semantics

This thesis presents a variety of models for probabilistic programming languages in the framework of concurrent games. Our starting point is the model of concurrent games with symmetry of Castellan, Clairambault and Winskel. We show that they form a symmetric monoidal closed bicategory, and that this can be turned into a cartesian closed bicategory using a linear exponential pseudo-comonad inspired by linear logic. Then, we enrich this with probability, relying heavily on Winskel’s model of probabilistic concurrent strategies. We see that the bicategorical structure is not perturbed by the addition of probability. We apply this model to two probabilistic languages: a probabilistic untyped λ-calculus, and Probabilistic PCF. For the former, we relate the semantics to the probabilistic Nakajima trees of Leventis, thus obtaining a characterisation of observational equivalence for programs in terms of strategies. For the latter, we show a definability result in the spirit of the game semantics tradition. This solves an open problem, as it is notoriously difficult to model Probabilistic PCF with sequential game semantics. Finally, we introduce a model for measurable game semantics, in which games and strategies come equipped with measure-theoretic structure allowing for an accurate description of computation with continuous data types. The objective of this model is to support computation with arbitrary probability measures on the reals. In the last part of this thesis we see how this can be done by equipping strategies with parametrised families of probability measures (also known as stochastic kernels), and we construct a bicategory of measurable concurrent games and probabilistic measurable strategies.

[1]  Glynn Winskel,et al.  Observably Deterministic Concurrent Strategies and Intensional Full Abstraction for Parallel-or , 2017, FSCD.

[2]  Radha Jagadeesan,et al.  Full Abstraction for PCF , 1994, Inf. Comput..

[3]  Thomas Ehrhard,et al.  Probabilistic coherence spaces are fully abstract for probabilistic PCF , 2014, POPL.

[4]  Stephen Lack,et al.  A Coherent Approach to Pseudomonads , 2000 .

[5]  Glynn Winskel,et al.  The concurrent game semantics of Probabilistic PCF , 2018, LICS.

[6]  C.-H. Luke Ong,et al.  On Full Abstraction for PCF: I, II, and III , 2000, Inf. Comput..

[7]  C.-H. Luke Ong,et al.  Nondeterminism in Game Semantics via Sheaves , 2015, 2015 30th Annual ACM/IEEE Symposium on Logic in Computer Science.

[8]  Noam Zeilberger Linear lambda terms as invariants of rooted trivalent maps , 2016, J. Funct. Program..

[9]  C.-H. Luke Ong,et al.  Innocent Strategies are Sheaves over Plays - Deterministic, Non-deterministic and Probabilistic Innocence , 2014, ArXiv.

[10]  C. Jones,et al.  A probabilistic powerdomain of evaluations , 1989, [1989] Proceedings. Fourth Annual Symposium on Logic in Computer Science.

[11]  Glynn Winskel,et al.  Probabilistic event structures and domains , 2004, Theor. Comput. Sci..

[12]  Dana S. Scott,et al.  A Type-Theoretical Alternative to ISWIM, CUCH, OWHY , 1993, Theor. Comput. Sci..

[13]  Pierre Clairambault,et al.  Causality vs. Interleavings in Concurrent Game Semantics , 2016, CONCUR.

[14]  Glynn Winskel,et al.  Game semantics for quantum programming , 2019, Proc. ACM Program. Lang..

[15]  Ohad Kammar,et al.  A convenient category for higher-order probability theory , 2017, 2017 32nd Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[16]  Michele Pagani,et al.  Strong Adequacy and Untyped Full-Abstraction for Probabilistic Coherence Spaces , 2019, FoSSaCS.

[17]  Achim Jung,et al.  The troublesome probabilistic powerdomain , 1997, COMPROX.

[18]  J. Norris Appendix: probability and measure , 1997 .

[19]  Ohad Kammar,et al.  A domain theory for statistical probabilistic programming , 2018, Proc. ACM Program. Lang..

[20]  Glynn Winskel,et al.  The cartesian closed bicategory of generalised species of structures , 2008 .

[21]  Michael Stay,et al.  Compact Closed Bicategories , 2013, 1301.1053.

[22]  Glynn Winskel,et al.  The Parallel Intensionally Fully Abstract Games Model of PCF , 2015, 2015 30th Annual ACM/IEEE Symposium on Logic in Computer Science.

[23]  Eugenio Moggi,et al.  Notions of Computation and Monads , 1991, Inf. Comput..

[24]  Claire Jones,et al.  Probabilistic non-determinism , 1990 .

[25]  Hugo Paquet,et al.  Probabilistic Programming Inference via Intensional Semantics , 2019, ESOP.

[26]  I. Moerdijk,et al.  Sheaves in geometry and logic: a first introduction to topos theory , 1992 .

[27]  Glynn Winskel,et al.  Event Structures with Symmetry , 2007, Computation, Meaning, and Logic.

[28]  Michael Shulman,et al.  Constructing symmetric monoidal bicategories , 2010, 1004.0993.

[29]  Glynn Winskel,et al.  Concurrent Strategies , 2011, 2011 IEEE 26th Annual Symposium on Logic in Computer Science.

[30]  Roman Fric,et al.  A Categorical Approach to Probability Theory , 2010, Stud Logica.

[31]  Giulio Manzonetto,et al.  Weighted Relational Models of Typed Lambda-Calculi , 2013, 2013 28th Annual ACM/IEEE Symposium on Logic in Computer Science.

[32]  Andrew M. Pitts,et al.  Computational Adequacy via "Mixed" Inductive Definitions , 1993, MFPS.

[33]  Marc de Visme Event Structures for Mixed Choice , 2019, CONCUR.

[34]  Thomas Ehrhard,et al.  Probabilistic coherence spaces as a model of higher-order probabilistic computation , 2011, Inf. Comput..

[35]  François Lamarche,et al.  Quantitative Domains and Infinitary Algebras , 1992, Theor. Comput. Sci..

[36]  Sam Staton,et al.  Commutative Semantics for Probabilistic Programming , 2017, ESOP.

[37]  Dominic R. Verity,et al.  ∞-Categories for the Working Mathematician , 2018 .

[38]  Samson Abramsky,et al.  Linearity, Sharing and State: a fully abstract game semantics for Idealized Algol with active expressions , 1996, Electron. Notes Theor. Comput. Sci..

[39]  Marcelo Fiore,et al.  A type theory for cartesian closed bicategories (Extended Abstract) , 2019, 2019 34th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[40]  Glynn Winskel Strategies as Profunctors , 2013, FoSSaCS.

[41]  Dexter Kozen,et al.  Semantics of probabilistic programs , 1979, 20th Annual Symposium on Foundations of Computer Science (sfcs 1979).

[42]  Russell Harmer,et al.  A fully abstract game semantics for finite nondeterminism , 1999, Proceedings. 14th Symposium on Logic in Computer Science (Cat. No. PR00158).

[43]  Glynn Winskel,et al.  Thin Games with Symmetry and Concurrent Hyland-Ong Games , 2019 .

[44]  Samson Abramsky,et al.  A fully abstract game semantics for general references , 1998, Proceedings. Thirteenth Annual IEEE Symposium on Logic in Computer Science (Cat. No.98CB36226).

[45]  Marco Grandis,et al.  Limits in double categories , 1999 .

[46]  R. A. G. Seely Modelling Computations: A 2-Categorical Framework , 1987, LICS.

[47]  O. Kallenberg Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[48]  N. Saheb-Djahromi,et al.  Probabilistic LCF , 1978, International Symposium on Mathematical Foundations of Computer Science.

[49]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[50]  Marco Grandis,et al.  Adjoint for double categories , 2004 .

[51]  Thomas A. Henzinger,et al.  Probabilistic programming , 2014, FOSE.

[52]  Glynn Winskel,et al.  Event Structures , 1986, Advances in Petri Nets.

[53]  Glynn Winskel,et al.  On the Expressivity of Symmetry in Event Structures , 2010, 2010 25th Annual IEEE Symposium on Logic in Computer Science.

[54]  Ugo Dal Lago,et al.  A lambda-calculus foundation for universal probabilistic programming , 2015, ICFP.

[55]  Andreas Blass,et al.  A Game Semantics for Linear Logic , 1992, Ann. Pure Appl. Log..

[56]  Glynn Winskel On Probabilistic Distributed Strategies , 2015, ICTAC.

[57]  Paul-André Melliès CATEGORICAL SEMANTICS OF LINEAR LOGIC , 2009 .

[58]  Vincent Danos,et al.  Probabilistic game semantics , 2002, TOCL.

[59]  Paul-André Melliès Categorical combinatorics of scheduling and synchronization in game semantics , 2019, Proc. ACM Program. Lang..

[60]  Glynn Winskel,et al.  Symmetry in concurrent games , 2014, CSL-LICS.

[61]  Glynn Winskel,et al.  Distributed Probabilistic and Quantum Strategies , 2013, MFPS.

[62]  Glynn Winskel,et al.  Games and Strategies as Event Structures , 2017, Log. Methods Comput. Sci..

[63]  R. Aumann Borel structures for function spaces , 1961 .

[64]  Jean-Yves Girard,et al.  Normal functors, power series and λ-calculus , 1988, Ann. Pure Appl. Log..

[65]  S. Shelah,et al.  Annals of Pure and Applied Logic , 1991 .

[66]  Ohad Kammar,et al.  Semantics for probabilistic programming: higher-order functions, continuous distributions, and soft constraints , 2016, 2016 31st Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[67]  G.D. Plotkin,et al.  LCF Considered as a Programming Language , 1977, Theor. Comput. Sci..

[68]  Thomas Ehrhard,et al.  Measurable cones and stable, measurable functions: a model for probabilistic higher-order programming , 2017, Proc. ACM Program. Lang..

[69]  Glynn Winskel,et al.  Continuous Probability Distributions in Concurrent Games , 2018, MFPS.

[70]  Albert Benveniste,et al.  True-concurrency probabilistic models: Branching cells and distributed probabilities for event structures , 2006, Inf. Comput..

[71]  Russell Harmer Games and full abstraction for non-deterministic languages , 1999 .

[72]  Dana S. Scott,et al.  Outline of a Mathematical Theory of Computation , 1970 .

[73]  Jean Goubault-Larrecq A Probabilistic and Non-Deterministic Call-by-Push-Value Language , 2019, 2019 34th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[74]  Radha Jagadeesan,et al.  Games and Full Completeness for Multiplicative Linear Logic , 1994, J. Symb. Log..

[75]  Glynn Winskel,et al.  Non-angelic Concurrent Game Semantics , 2018, FoSSaCS.

[76]  Simon Castellan,et al.  Concurrent Structures in Game Semantics , 2017, Bull. EATCS.

[77]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[78]  Hugo Paquet,et al.  Fully Abstract Models of the Probabilistic lambda-calculus , 2018, CSL.

[79]  Jean Goubault-Larrecq Full abstraction for non-deterministic and probabilistic extensions of PCF I: The angelic cases , 2015, J. Log. Algebraic Methods Program..

[80]  Maribel Fernández The Lambda Calculus , 2009 .

[81]  Glynn Winskel Deterministic concurrent strategies , 2012, Formal Aspects of Computing.

[82]  N. Saheb-Djahromi,et al.  CPO'S of Measures for Nondeterminism , 1980, Theor. Comput. Sci..

[83]  Thomas Ehrhard,et al.  The Computational Meaning of Probabilistic Coherence Spaces , 2011, 2011 IEEE 26th Annual Symposium on Logic in Computer Science.

[84]  James Laird,et al.  Full abstraction for functional languages with control , 1997, Proceedings of Twelfth Annual IEEE Symposium on Logic in Computer Science.

[85]  Glynn Winskel,et al.  Petri Nets, Event Structures and Domains , 1979, Semantics of Concurrent Computation.

[86]  Samson Abramsky,et al.  Call-by-Value Games , 1997, CSL.