Privacy Verification in POMDPs via Barrier Certificates

Privacy is an increasing concern in cyber-physical systems that operates over a shared network. In this paper, we propose a method for privacy verification of cyber-physical systems modeled by Markov decision processes (MDPs) and partially-observable Markov decision processes (POMDPs) based on barrier certificates. To this end, we consider an opacity-based notion of privacy, which is characterized by the beliefs in system states. We show that the belief update equations can be represented as discrete-time switched systems, for which we propose a set of conditions for privacy verification in terms of barrier certificates. We further demonstrate that, for MDPs and for POMDPs, privacy verification can be computationally implemented by solving a set of semi-definite programs and sum-of-squares programs, respectively. The method is illustrated by an application to privacy verification of an inventory management system.

[1]  Graziano Chesi,et al.  LMI Techniques for Optimization Over Polynomials in Control: A Survey , 2010, IEEE Transactions on Automatic Control.

[2]  Magnus Egerstedt,et al.  Nonsmooth Barrier Functions With Applications to Multi-Robot Systems , 2017, IEEE Control Systems Letters.

[3]  Nils Jansen,et al.  Verification of Uncertain POMDPs Using Barrier Certificates , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Hai Lin,et al.  Assume-guarantee reasoning framework for MDP-POMDP , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[5]  Ufuk Topcu,et al.  A sublinear algorithm for barrier-certificate-based data-driven model validation of dynamical systems , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[6]  Milos Hauskrecht,et al.  Value-Function Approximations for Partially Observable Markov Decision Processes , 2000, J. Artif. Intell. Res..

[7]  M. Johansson,et al.  Piecewise Linear Control Systems , 2003 .

[8]  Janan Zaytoon,et al.  Safety verification and reachability analysis for hybrid systems , 2009, Annu. Rev. Control..

[9]  Jean-Jacques Lesage,et al.  Overview of discrete event systems opacity: Models, validation, and quantification , 2016, Annu. Rev. Control..

[10]  P. Parrilo.  Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization , 2000 .

[11]  Markus Schweighofer,et al.  On the complexity of Putinar's Positivstellensatz , 2005, J. Complex..

[12]  Alexandre M. Bayen,et al.  Computational techniques for the verification of hybrid systems , 2003, Proc. IEEE.

[13]  A. Vicino,et al.  On convexification of some minimum distance problems , 1999, 1999 European Control Conference (ECC).

[14]  Tamás Terlaky,et al.  A Survey of the S-Lemma , 2007, SIAM Rev..

[15]  J. Lasserre.  Moments, Positive Polynomials And Their Applications , 2009 .

[16]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[17]  Srdjan Capkun,et al.  The security and privacy of smart vehicles , 2004, IEEE Security & Privacy Magazine.

[18]  Stephen Prajna.  Barrier certificates for nonlinear model validation , 2006, Autom..

[19]  Tobias J. Oechtering,et al.  Privacy-preserving energy flow control in smart grids , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Rance Cleaveland,et al.  A framework for opacity in linear systems , 2016, 2016 American Control Conference (ACC).

[21]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[22]  A. Cassandra.  A Survey of POMDP Applications , 2003 .

[23]  Johan Efberg,et al.  YALMIP : A toolbox for modeling and optimization in MATLAB , 2004 .

[24]  Patrick D. McDaniel,et al.  Security and Privacy Challenges in the Smart Grid , 2009, IEEE Security & Privacy.

[25]  Krishnendu Chatterjee,et al.  What is decidable about partially observable Markov decision processes with ω-regular objectives , 2013, J. Comput. Syst. Sci..

[26]  Aaron D. Ames,et al.  Safety Barrier Certificates for Collisions-Free Multirobot Systems , 2017, IEEE Transactions on Robotics.

[27]  A. Papachristodoulou,et al.  A tutorial on sum of squares techniques for systems analysis , 2005, Proceedings of the 2005, American Control Conference, 2005..

[28]  Mohamadreza Ahmadi,et al.  Safety verification for distributed parameter systems using barrier functionals , 2017, Syst. Control. Lett..

[29]  Hai Lin,et al.  POMDP Model Learning for Human Robot Collaboration , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[30]  Hai Lin,et al.  Privacy Preserving Controller Synthesis via Belief Abstraction , 2018, ArXiv.

[31]  Mohamadreza Ahmadi,et al.  An optimization-based method for bounding state functionals of nonlinear stochastic systems , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[32]  Parv Venkitasubramaniam,et al.  The privacy analysis of battery control mechanisms in demand response: Revealing state approach and rate distortion bounds , 2014, 53rd IEEE Conference on Decision and Control.

[33]  Stéphane Lafortune,et al.  Comparative analysis of related notions of opacity in centralized and coordinated architectures , 2013, Discret. Event Dyn. Syst..

[34]  Hai Lin,et al.  Privacy Verification and Enforcement via Belief Abstraction , 2018, IEEE Control Systems Letters.

[35]  Ufuk Topcu,et al.  Controller Synthesis for Safety of Physically-Viable Data-Driven Models , 2018, 1801.04072.

[36]  K. Courtney.  Privacy and Senior Willingness to Adopt Smart Home Information Technology in Residential Care Facilities , 2008, Methods of Information in Medicine.

[37]  Rafael Wisniewski,et al.  Converse Barrier Certificate Theorems , 2016, IEEE Transactions on Automatic Control.

[38]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[39]  B. Reznick,et al.  Sums of squares of real polynomials , 1995 .

[40]  Guy Shani,et al.  Noname manuscript No. (will be inserted by the editor) A Survey of Point-Based POMDP Solvers , 2022 .

[41]  Sina Ober-Blöbaum,et al.  Second-Order Switching Time Optimization for Switched Dynamical Systems , 2016, IEEE Transactions on Automatic Control.

[42]  Sebastian Junges,et al.  Permissive Finite-State Controllers of POMDPs using Parameter Synthesis , 2017, ArXiv.