A Class of Near-Optimal Local Minima for Witsenhausen’s Problem

This paper is the continuation of the research initiated in our previous work aiming to analytically support the existence of near-piecewise-linear local optima for Witsenhausen’s problem for a highly volatile state, which had been suspected of being the optimal solution in the past based on numerical evidence. The core idea of our previous work was to pose Witsenhausen’s problem as a leader-follower coordination game of asymmetric information, and carefully construct a class of near-piecewise-linear strategies for the leader that stays invariant under the best response operator. This invariance set of strategies was then used to show the existence of a near-piecewise-linear equilibrium strategy for the leader. One major contribution of the current work is to refine the set of strategies proposed in our previous work to include more efficient local minima. In fact, we explicitly specify a range of values for the number of segments in the proposed near-piecewise-linear strategies (as a function of the state variance), which yields local minima of the same order as of the global optimal solution. This has required major refinement of the bounds and proofs in the best response analysis. As another key contribution and to compare the performance of the proposed local optima with the global optimal solution, we use results from the asymptotic quantization theory to upper-bound the cost of the proposed local minima. Combining it with an asymptotic upper bound on the optimal cost obtained from existing results in the literature, we show that the cost of the proposed local minima are at most a constant factor away from the optimal cost.

[1]  M. Dufwenberg Game theory. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[2]  Ali Jadbabaie,et al.  Local Optimality of Almost Piecewise-Linear Quantizers for Witsenhausen's Problem , 2021, IEEE Transactions on Automatic Control.

[3]  David L. Neuhoff,et al.  On the support of MSE-optimal, fixed-rate, scalar quantizers , 2001, IEEE Trans. Inf. Theory.

[4]  Ali Jadbabaie,et al.  Slopey quantizers are locally optimal for Witsenhausen's counterexample , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[5]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[6]  Jason R. Marden,et al.  Learning approaches to the Witsenhausen counterexample from a view of potential games , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[7]  P. F. Panter,et al.  Quantization distortion in pulse-count modulation with nonuniform spacing of levels , 1951, Proceedings of the IRE.

[8]  S. Mitter,et al.  Information and control: Witsenhausen revisited , 1999 .

[9]  Kenneth Rose,et al.  A deterministic annealing approach to Witsenhausen's counterexample , 2014, 2014 IEEE International Symposium on Information Theory.

[10]  Sergio Verdú,et al.  Witsenhausen's counterexample: A view from optimal transport theory , 2011, IEEE Conference on Decision and Control and European Control Conference.

[11]  Thomas Parisini,et al.  Numerical solutions to the Witsenhausen counterexample by approximating networks , 2001, IEEE Trans. Autom. Control..

[12]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[13]  Anant Sahai,et al.  Approximately Optimal Solutions to the Finite-Dimensional Witsenhausen Counterexample , 2013, IEEE Transactions on Automatic Control.

[14]  Yu-Chi Ho,et al.  The Witsenhausen counterexample: a hierarchical search approach for nonconvex optimization problems , 2001, IEEE Trans. Autom. Control..