AN IMPROVEMENT OF MARKOVIAN INTEGRATION BY PARTS FORMULA AND APPLICATION TO SENSITIVITY COMPUTATION

This paper establishes a new version of integration by parts formula of Markov chains for sensitivity computation, under much lower restrictions than the existing researches. Our approach is more fundamental and applicable without using Girsanov theorem or Malliavin calculus as did by past papers. Numerically, we apply this formula to compute sensitivity regarding the transition rate matrix and compare with a recent research by an IPA (infinitesimal perturbation analysis) method and other approaches.

[1]  Samuel N. Cohen.  Chaos representations for Marked Point Processes , 2011, 1110.0635.

[2]  Pierre-Louis Lions,et al.  Applications of Malliavin calculus to Monte Carlo methods in finance , 1999, Finance Stochastics.

[3]  T. Siu.  Integration by Parts and Martingale Representation for a Markov Chain , 2014 .

[4]  L. Denis,et al.  Malliavin calculus for Markov chains using perturbations of time , 2016 .

[5]  R. Kawai,et al.  GREEKS FORMULAS FOR AN ASSET PRICE MODEL WITH GAMMA PROCESSES , 2010 .

[6]  Michael C. Fu,et al.  Sensitivity Analysis for Monte Carlo Simulation of Option Pricing , 1995, Probability in the Engineering and Informational Sciences.

[7]  M. Fu,et al.  Efficient Design and Sensitivity Analysis of Control Charts Using Monte Carlo Simulation , 1999 .

[8]  On Chaos Representation and Orthogonal Polynomials for the Doubly Stochastic Poisson Process , 2013 .

[9]  Xi-Ren Cao,et al.  Algorithms for sensitivity analysis of Markov systems through potentials and perturbation realization , 1998, IEEE Trans. Control. Syst. Technol..

[10]  P. Biane.  Chaotic representation for finite Markov chains , 1990 .

[11]  Wiener analysis of functionals of a Markov chain: Application to neural transformations of random signals , 1980, Biological Cybernetics.

[12]  Mark H. A. Davis,et al.  Malliavin Monte Carlo Greeks for jump diffusions , 2006 .

[13]  Xi-Ren Cao,et al.  Stochastic learning and optimization - A sensitivity-based approach , 2007, Annu. Rev. Control..

[14]  J. Bismut.  Calcul des variations stochastique et processus de sauts , 1983 .

[15]  Nicolas Privault,et al.  Discrete chaotic calculus and covariance identities , 2002 .

[16]  Nicolas Privault,et al.  Understanding Markov Chains , 2013 .

[17]  G. Pflug,et al.  Perturbation analysis of inhomogeneous finite Markov chains , 2016, Advances in Applied Probability.

[18]  Nicolas Privault,et al.  An integration by parts formula in a Markovian regime switching model and application to sensitivity analysis , 2017 .