Stochastic factorizations, sandwiched simplices and the topology of the space of explanations

We study the space of stochastic factorizations of a stochastic matrix V, motivated by the statistical problem of hidden random variables. We show that this space is homeomorphic to the space of simplices sandwiched between two nested convex polyhedra, and use this geometrical model to gain some insight into its structure and topology. We prove theorems describing its homotopy type, and, in the case where the rank of V is 2, we give a complete description, including bounds on the number of connected components, and examples in which these bounds are attained. We attempt to make the notions of topology accessible and relevant to statisticians.

[1]  R. Kass,et al.  Geometrical Foundations of Asymptotic Inference: Kass/Geometrical , 1997 .

[2]  J. Milnor Singular points of complex hypersurfaces , 1968 .

[3]  Marie-Françoise Roy,et al.  Real algebraic geometry , 1992 .

[4]  Z. Gilula Singular value decomposition of probability matrices: Probabilistic aspects of latent dichotomous variables , 1979 .

[5]  L. Siebenmann,et al.  Deformation of homeomorphisms on stratified sets , 1972 .

[6]  J. Milnor Topology from the differentiable viewpoint , 1965 .

[7]  Hajime Sato Algebraic Topology: An Intuitive Approach , 1999 .

[8]  Raffaella Settimi,et al.  Geometry, moments and conditional independence trees with hidden variables , 2000 .

[9]  F. Clarke,et al.  Topological Geometry: THE INVERSE FUNCTION THEOREM , 1981 .

[10]  Jim Q. Smith,et al.  On the Geometry of Bayesian Graphical Models with Hidden Variables , 1998, UAI.

[11]  Joel E. Cohen,et al.  Nonnegative ranks, decompositions, and factorizations of nonnegative matrices , 1993 .

[12]  M. Goresky,et al.  Stratified Morse theory , 1988 .

[13]  Jim Q. Smith,et al.  Discrete mixtures in Bayesian networks with hidden variables: a latent time budget example , 2003, Comput. Stat. Data Anal..

[14]  COMMUNICATIONS OF THE MOSCOW MATHEMATICAL SOCIETY: The topological classification of germs of the maximum and minimax functions of a family of functions in general position , 1982 .

[15]  L. Siebenmann ON COMPLEXES THAT ARE LIPSCHITZ MANIFOLDS , 1979 .

[16]  Dan Geiger,et al.  Graphical Models and Exponential Families , 1998, UAI.

[17]  John Milnor,et al.  Singular Points of Complex Hypersurfaces. (AM-61), Volume 61 , 1969 .

[18]  V. Goryunov Monodromy of the image of the mapping C2 → C3 , 1991 .

[19]  D. Geiger,et al.  Stratified exponential families: Graphical models and model selection , 2001 .

[20]  Sharon-Lise T. Normand [Bayesian Analysis in Expert Systems]: Comment , 1993 .