Collective Properties of Neural Networks

A neural network is basically made of interconnected threshold automata i. (i=1,…., N) collecting the signals Sj produced by a set of upstream units j and delivering an output signal Si to a set of downstream units k. The evolution of the dynamic variables is driven by the following equations: $$ {S_i}(t) = F({V_i}(\{ {S_i}(t - {\Delta_{{ij}}})\} - {e_i}) $$ (1) where F is a sigmoid function, Vi the membrane potential of i, Δij the transmission delay between the units j and i and ei the threshold of i.