Graphoid-based methodologies in modeling, analysis, identification and control of networks of dynamic systems

There is extensive literature on the description of joint probability distributions via graphs, where each node represents a random variable and the edges describe a form of coupling among the variables. The connections in these graphical models do not necessarily represent forms of input/output relations among the variables involved. Instead, they typically represent a convenient factorization of their joint probability distribution. For these factorizations to be mathematically meaningful, the underlying graph structure is required to have no directed cycles. Thus, graphical models of random variables typically deal with directed acyclic graphs (DAGs). Conversely, in the area of dynamic systems, and especially control theory, it is common to find network models involving stochastic processes that influence each other according to a directed graph. In this case the graph connections do indeed represent a input/output relations and feedback loops may be present, as well. As a consequence, the network structures underlying graphical models of random variables and networks of dynamic systems differ fundamentally. Furthermore, it is not a straightforward task to unify or reconcile these two semantically different graph descriptions. Indeed, introducing a notion of factorization in networks of dynamic systems would present technical difficulties due not only to the potential presence of loops, but also to the fact that stochastic processes involve an infinite number of random variables. Despite these differences, it has become evident during recent years that methodologies can be borrowed from probabilistic graphical models and used for the analysis, identification and control design in the domain of networks of dynamic systems and viceversa. Some of these methodologies can be imported with no significant modifications, while others need to be substantially revisited. This article is an attempt to bridge the conceptual and methodological gap between graphical models of random variables and networks of dynamic systems, creating a single unified language and theoretical framework for these two different classes. This is achieved by drawing parallels between similar approaches and highlighting their main differences.

[1]  D. Botstein,et al.  Cluster analysis and display of genome-wide expression patterns. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Franz von Kutschera,et al.  Causation , 1993, J. Philos. Log..

[3]  Vincent Y. F. Tan,et al.  Learning Latent Tree Graphical Models , 2010, J. Mach. Learn. Res..

[4]  D. Materassi,et al.  On the problem of reconstructing an unknown topology , 2010, Proceedings of the 2010 American Control Conference.

[5]  Sean C. Warnick,et al.  Dynamical structure function identifiability conditions enabling signal structure reconstruction , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[6]  Murti V. Salapaka,et al.  On the Problem of Reconstructing an Unknown Topology via Locality Properties of the Wiener Filter , 2010, IEEE Transactions on Automatic Control.

[7]  Eduardo Sontag,et al.  Modular cell biology: retroactivity and insulation , 2008, Molecular systems biology.

[8]  Steffen L. Lauritzen,et al.  Graphical models in R , 1996 .

[9]  Murti V. Salapaka,et al.  Identification of network components in presence of unobserved nodes , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[10]  Murti V. Salapaka,et al.  Reconstruction of directed acyclic networks of dynamical systems , 2013, 2013 American Control Conference.

[11]  C. N. Liu,et al.  Approximating discrete probability distributions with dependence trees , 1968, IEEE Trans. Inf. Theory.

[12]  Donatello Materassi,et al.  Topological identification in networks of dynamical systems , 2008, 2008 47th IEEE Conference on Decision and Control.

[13]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[14]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[15]  A. Barabasi,et al.  Hierarchical Organization of Modularity in Metabolic Networks , 2002, Science.

[16]  Mehran Mesbahi,et al.  Network identification via node knock-out , 2010, 49th IEEE Conference on Decision and Control (CDC).

[17]  Rosario N. Mantegna,et al.  Book Review: An Introduction to Econophysics, Correlations, and Complexity in Finance, N. Rosario, H. Mantegna, and H. E. Stanley, Cambridge University Press, Cambridge, 2000. , 2000 .

[18]  Judea Pearl,et al.  Causal networks: semantics and expressiveness , 2013, UAI.

[19]  Philippe Lagacherie,et al.  Modelling Spatial Variability Along Drainage Networks with Geostatistics , 2006 .

[20]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[21]  Ilan Lobel,et al.  BAYESIAN LEARNING IN SOCIAL NETWORKS , 2008 .

[22]  Murti V. Salapaka,et al.  Notions of Separation in Graphs of Dynamical Systems , 2014 .

[23]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[24]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[25]  Judea Pearl,et al.  The recovery of causal poly-trees from statistical data , 1987, Int. J. Approx. Reason..

[26]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[27]  Samuel J. Mason,et al.  Feedback Theory-Some Properties of Signal Flow Graphs , 1953, Proceedings of the IRE.

[28]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[29]  S. Bressler,et al.  Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Reinhard Diestel,et al.  Graph Theory , 1997 .

[31]  Joe H. Chow,et al.  Time scale modeling of sparse dynamic networks , 1985 .

[32]  R. Sokal,et al.  A QUANTITATIVE APPROACH TO A PROBLEM IN CLASSIFICATION† , 1957, Evolution; International Journal of Organic Evolution.

[33]  Donatello Materassi,et al.  A modeling approach to multivariate analysis and clusterization theory , 2008 .

[34]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[35]  R. Mantegna Hierarchical structure in financial markets , 1998, cond-mat/9802256.

[36]  Philippe Lagacherie,et al.  Geostatistical modelling of spatial processes on directed trees: Application to fluvisol extent , 2005 .

[37]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[38]  James Roberts,et al.  Network structure of production , 2011, Proceedings of the National Academy of Sciences.

[39]  Murti V. Salapaka,et al.  Network reconstruction of dynamical polytrees with unobserved nodes , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[40]  Shenyang Guo,et al.  Structural Equation Modeling Concepts , 2011 .