Network Identifiability from Intrinsic Noise

This paper considers the problem of inferring an unknown network of dynamical systems driven by unknown, intrinsic, noise inputs. Equivalently we seek to identify direct causal dependencies among manifest variables only from observations of these variables. For linear, time-invariant systems of minimal order, we characterise under what conditions this problem is well posed. We first show that if the transfer matrix from the inputs to manifest states is minimum phase, this problem has a unique solution irrespective of the network topology. This is equivalent to there being only one valid spectral factor (up to a choice of signs of the inputs) of the output spectral density. If the assumption of phase-minimality is relaxed, we show that the problem is characterised by a single Algebraic Riccati Equation (ARE), of dimension determined by the number of latent states. The number of solutions to this ARE is an upper bound on the number of solutions for the network. We give necessary and sufficient conditions for any two dynamical networks to have equal output spectral density, which can be used to construct all equivalent networks. Extensive simulations quantify the number of solutions for a range of problem sizes. For a slightly simpler case, we also provide an algorithm to construct all equivalent networks from the output spectral density.

[1]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[2]  J. Willems,et al.  Parametrizations of linear dynamical systems: Canonical forms and identifiability , 1974 .

[3]  W. Haemers,et al.  Which graphs are determined by their spectrum , 2003 .

[4]  Erdal Atukeren,et al.  Christmas cards, Easter bunnies, and Granger-causality , 2008 .

[5]  Leiba Rodman,et al.  Algebraic Riccati equations , 1995 .

[6]  Murti V. Salapaka,et al.  On the Problem of Reconstructing an Unknown Topology via Locality Properties of the Wiener Filter , 2010, IEEE Transactions on Automatic Control.

[7]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[8]  Xavier Bombois,et al.  Identification of dynamic models in complex networks with prediction error methods - Basic methods for consistent module estimates , 2013, Autom..

[9]  Shahin Shahrampour,et al.  Topology Identification of Directed Dynamical Networks via Power Spectral Analysis , 2013, IEEE Transactions on Automatic Control.

[10]  G. Michailidis,et al.  Autoregressive models for gene regulatory network inference: sparsity, stability and causality issues. , 2013, Mathematical biosciences.

[11]  Arild Thowsen,et al.  Structural identifiability , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[12]  D. Youla,et al.  On the factorization of rational matrices , 1961, IRE Trans. Inf. Theory.

[13]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[14]  Murti V. Salapaka,et al.  Network reconstruction of dynamical polytrees with unobserved nodes , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[15]  Alessandro Chiuso,et al.  A Bayesian approach to sparse dynamic network identification , 2012, Autom..

[16]  M. Elowitz,et al.  Regulatory activity revealed by dynamic correlations in gene expression noise , 2008, Nature Genetics.

[17]  Paul P. Wang,et al.  Advances to Bayesian network inference for generating causal networks from observational biological data , 2004, Bioinform..

[18]  Jitendra Tugnait,et al.  Blind identifiability of FIR-MIMO systems with colored input using second order statistics , 2000, IEEE Signal Processing Letters.

[19]  Mi-Ching Tsai,et al.  Robust and Optimal Control , 2014 .

[20]  J. Raser,et al.  Noise in Gene Expression: Origins, Consequences, and Control , 2005, Science.

[21]  B. Anderson.  The inverse problem of stationary covariance generation , 1969 .

[22]  Wen-Xu Wang,et al.  Noise bridges dynamical correlation and topology in coupled oscillator networks. , 2010, Physical review letters.

[23]  Mehran Mesbahi,et al.  Network Identification via Node Knockout , 2010, IEEE Transactions on Automatic Control.

[24]  Sean C. Warnick,et al.  Necessary and Sufficient Conditions for Dynamical Structure Reconstruction of LTI Networks , 2008, IEEE Transactions on Automatic Control.