Existence and uniqueness of GEXIT curves via the Wasserstein metric

In the analysis of iterative coding systems it is often necessary to compare two densities and to measure how close they are. Sometimes it is convenient to compare their entropy or their Battacharyya parameter. But sometimes a more powerful measure is required. The Wasserstein metric is a convenient choice. We derive some basic properties of the Wasserstein metric which are important in the context of iterative coding. In particular, we will see how the Wasserstein metric compares to some other natural measures (such as the difference of entropies or Battacharyya parameters) and how the Wasserstein metric behaves under “natural” operations, like variable — or check-node convolution or under convex combinations. As an “application” we show how to prove the existence of the belief propagation Generalized EXIT curve for a non-trivial portion of the parameters.

[1]  Vladimir M. Zolotarev,et al.  Modern Theory of Summation of Random Variables , 1997 .

[2]  Andrea Montanari,et al.  The Generalized Area Theorem and Some of its Consequences , 2005, IEEE Transactions on Information Theory.

[3]  Andrea Montanari,et al.  Maxwell Construction: The Hidden Bridge Between Iterative and Maximum a Posteriori Decoding , 2005, IEEE Transactions on Information Theory.

[4]  Andrea Montanari,et al.  Maxwell's construction: the hidden bridge between maximum-likelihood and iterative decoding , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[5]  C. Villani Optimal Transport: Old and New , 2008 .

[6]  Rüdiger L. Urbanke,et al.  Threshold Saturation via Spatial Coupling: Why Convolutional LDPC Ensembles Perform So Well over the BEC , 2010, IEEE Transactions on Information Theory.

[7]  Rüdiger L. Urbanke,et al.  Modern Coding Theory , 2008 .

[8]  Rüdiger L. Urbanke,et al.  Threshold saturation on BMS channels via spatial coupling , 2010, 2010 6th International Symposium on Turbo Codes & Iterative Information Processing.

[9]  Виктор Макарович Круглов,et al.  Рецензия на книгу Vladimir М. Zolotarev “Modern Theory of Summation of Random Variables”@@@Book review: Vladimir M. Zolotarev “Modern Theory of Summation of Random Variables” , 1999 .

[10]  Gerhard Fettweis,et al.  Asymptotically good LDPC convolutional codes with AWGN channel thresholds close to the Shannon limit , 2010, 2010 6th International Symposium on Turbo Codes & Iterative Information Processing.