A Maximum Entropy Approach to the Realizability of Spin

Paolo Dai Pra , Michele Pavon * and Neeraja SahasrabudheDepartment of Mathematics, University of Padova, via Trieste 63, 35121 Padova, Italy;E-Mails: daipra@math.unipd.it (P.D.P.); neeraja@math.unipd.it (N.S.)* Author to whom correspondence should be addressed; E-Mail: pavon@math.unipd.it;Tel.: +39-049-827-1341; Fax: +39-049-827-1428.Received: 26 February 2013; in revised form: 10 June 2013 / Accepted: 15 June 2013 /Published: 21 June 2013Abstract: Deriving the form of the optimal solution of a maximum entropy problem, weobtain an infinite family of linear inequalities characterizing the polytope of spin correlationmatrices. For n6, the facet description of such a polytope is provided through a minimalsystem of Bell-type inequalities.Keywords: correlation matrix; spin system; maximum entropy; Bell’s inequalities;moment problem1. IntroductionMoment problems are fairly common in many areas of applied mathematics, statistics and probability,economics, engineering, physics and operations research. Historically, moment problems came intofocus with Stieltjes in 1894 [1], in the context of studying the analytic behavior of continued fractions.The term “moment” was borrowed from mechanics: the moments could represent the total mass ofan unknown mass density, the torque necessary to support the mass on a beam, etc. Over time,however, moment problems took the shape of an important field in their own right. A deep connectionwith convex geometry was discovered by Krein in the mid 1930s and developed by the Russianschool; see, e.g., [2,3]. Another fundamental connection with the work of Caratheodory, Toeplitz,Schur, Nevanlinna and Pick on analytic interpolation was investigated in the first half of the twentiethcentury [4]. This led to important developments in operator theory; see, e.g., [5,6]. In more recenttimes, a rather impressive application and generalization of this mathematics has been developed by the

[1]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[2]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[3]  D. Sarason Generalized interpolation in , 1967 .

[4]  E. Davidson Linear Inequalities for Density Matrices , 1969 .

[5]  M. Kreĭn,et al.  The Markov Moment Problem and Extremal Problems , 1977 .

[6]  E. Jaynes On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[7]  D. Luenberger,et al.  Estimation of structured covariance matrices , 1982, Proceedings of the IEEE.

[8]  Tryphon T. Georgiou,et al.  Realization of power spectra from partial covariance sequences , 1987, IEEE Trans. Acoust. Speech Signal Process..

[9]  Colin L. Mallows,et al.  Embedding nonnegative definite Toeplitz matrices in nonnegative definite circulant matrices, with application to covariance estimation , 1989, IEEE Trans. Inf. Theory.

[10]  Itamar Pitowsky,et al.  Correlation polytopes: Their geometry and complexity , 1991, Math. Program..

[11]  I. Csiszár Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[12]  M. Laurent The real positive semidefinite completion problem for series-parallel graphs , 1997 .

[13]  T. Stieltjes Recherches sur les fractions continues , 1995 .

[14]  Komei Fukuda,et al.  Double Description Method Revisited , 1995, Combinatorics and Computer Science.

[15]  C. Byrnes,et al.  A complete parameterization of all positive rational extensions of a covariance sequence , 1995, IEEE Trans. Autom. Control..

[16]  Charles R. Johnson,et al.  The Real Positive Definite Completion Problem: Cycle Completability , 1996 .

[17]  Michel Deza,et al.  Geometry of cuts and metrics , 2009, Algorithms and combinatorics.

[18]  C. Byrnes,et al.  On the partial stochastic realization problem , 1997, IEEE Trans. Autom. Control..

[19]  David Bremner,et al.  Primal—Dual Methods for Vertex and Facet Enumeration , 1998, Discret. Comput. Geom..

[20]  H. Dym,et al.  On three Krein extension problems and some generalizations , 1998 .

[21]  J. C. Gupta CHARACTERISATION OF CORRELATION MATRICES OF SPIN VARIABLES , 1999 .

[22]  C. Byrnes,et al.  A Convex Optimization Approach to the Rational Covariance Extension Problem , 1999 .

[23]  Tryphon T. Georgiou,et al.  The interpolation problem with a degree constraint , 1999, IEEE Trans. Autom. Control..

[24]  Charles R. Johnson,et al.  Positive definite completions and determinant maximization , 1999 .

[25]  Tryphon T. Georgiou,et al.  A generalized entropy criterion for Nevanlinna-Pick interpolation with degree constraint , 2001, IEEE Trans. Autom. Control..

[26]  Monique Laurent,et al.  Polynomial Instances of the Positive Semidefinite and Euclidean Distance Matrix Completion Problems , 2000, SIAM J. Matrix Anal. Appl..

[27]  Michael M. Wolf,et al.  Bell inequalities and entanglement , 2001, Quantum Inf. Comput..

[28]  T. Georgiou The structure of state covariances and its relation to the power spectrum of the input , 2002, IEEE Trans. Autom. Control..

[29]  Tryphon T. Georgiou,et al.  Spectral analysis based on the state covariance: the maximum entropy spectrum and linear fractional parametrization , 2002, IEEE Trans. Autom. Control..

[30]  Anders Lindquist,et al.  Identifiability and Well-Posedness of Shaping-Filter Parameterizations: A Global Analysis Approach , 2002, SIAM J. Control. Optim..

[31]  K. Parthasarathy On extremal correlations , 2002 .

[32]  Anders Lindquist,et al.  Matrix-valued Nevanlinna-Pick interpolation with complexity constraint: an optimization approach , 2003, IEEE Trans. Autom. Control..

[33]  Tryphon T. Georgiou,et al.  Kullback-Leibler approximation of spectral density functions , 2003, IEEE Trans. Inf. Theory.

[34]  C. Byrnes,et al.  Generalized interpolation in $H^\infty$ with a complexity constraint , 2004 .

[35]  Tryphon T. Georgiou,et al.  Noninvasive estimation of tissue temperature via high-resolution spectral analysis techniques , 2005, IEEE Transactions on Biomedical Engineering.

[36]  Tryphon T. Georgiou,et al.  Solution of the general moment problem via a one-parameter imbedding , 2005, IEEE Transactions on Automatic Control.

[37]  Tryphon T. Georgiou,et al.  Remarks on control design with degree constraint , 2006, IEEE Transactions on Automatic Control.

[38]  Tryphon T. Georgiou,et al.  A Convex Optimization Approach to ARMA Modeling , 2008, IEEE Transactions on Automatic Control.

[39]  Johan Karlsson,et al.  Minimal Itakura-Saito distance and covariance interpolation , 2008, 2008 47th IEEE Conference on Decision and Control.

[40]  Michele Pavon,et al.  Hellinger Versus Kullback–Leibler Multivariable Spectrum Approximation , 2007, IEEE Transactions on Automatic Control.

[41]  Anders Lindquist,et al.  Important Moments in Systems and Control , 2008, SIAM J. Control. Optim..

[42]  Michele Pavon,et al.  A Globally Convergent Matricial Algorithm for Multivariate Spectral Estimation , 2008, IEEE Transactions on Automatic Control.

[43]  J. Lebowitz,et al.  Necessary and sufficient conditions for realizability of point processes , 2009, 0910.1710.

[44]  Michele Pavon,et al.  Matrix Completion à la Dempster by the Principle of Parsimony , 2011, IEEE Transactions on Information Theory.

[45]  Francesca P. Carli,et al.  A Maximum Entropy Solution of the Covariance Extension Problem for Reciprocal Processes , 2011, IEEE Transactions on Automatic Control.

[46]  Michele Pavon,et al.  A Maximum Entropy Enhancement for a Family of High-Resolution Spectral Estimators , 2012, IEEE Transactions on Automatic Control.

[47]  Michele Pavon,et al.  Time and Spectral Domain Relative Entropy: A New Approach to Multivariate Spectral Estimation , 2011, IEEE Transactions on Automatic Control.

[48]  M. Pavon,et al.  A Note on the Geometric Interpretation of Bell’s Inequalities , 2013, 1301.4823.