Stationary and dynamical properties of information entropies in nonextensive systems.

The Tsallis entropy and Fisher information entropy (matrix) are very important quantities expressing information measures in nonextensive systems. Stationary and dynamical properties of the information entropies have been investigated in the N -unit coupled Langevin model subjected to additive and multiplicative white noise, which is one of typical nonextensive systems. We have made detailed, analytical and numerical study on the dependence of the stationary-state entropies on additive and multiplicative noise, external inputs, couplings, and number of constitutive elements (N) . By solving the Fokker-Planck equation (FPE) by both the proposed analytical scheme and the partial difference equation method, transient responses of the information entropies to an input signal and an external force have been investigated. We have calculated the information entropies also with the use of the probability distribution derived by the maximum-entropy method, whose result is compared to that obtained by the FPE. The Cramér-Rao inequality is shown to be expressed by the extended Fisher entropy, which is different from the generalized Fisher entropy obtained from the generalized Kullback-Leibler divergence in conformity with the Tsallis entropy. The effect of additive and multiplicative colored noise on information entropies is discussed also.

[1]  Gurupada Goswami,et al.  Colored thermal noise driven dynamical system in the presence and absence of non-equilibrium constraint: time dependence of information entropy flux and entropy production , 2005 .

[2]  Hideo Hasegawa.  Generalized rate-code model for neuron ensembles with finite populations. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Constantino Tsallis,et al.  What should a statistical mechanics satisfy to reflect nature , 2004, cond-mat/0403012.

[4]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[5]  C. Tsallis,et al.  The role of constraints within generalized nonextensive statistics , 1998 .

[6]  Quantum Fisher Information and q-Deformed Relative Entropies : Additivity vs Nonadditivity(COMPLEXITY AND NONEXTENSIVITY:NEW TRENDS IN STATISTICAL MECHANICS) , 2006 .

[7]  D. Osorio-González,et al.  Entropy and thermalization of particles in liquids , 2003 .

[8]  Fluctuation Dissipation Relation for a Langevin Model with Multiplicative Noise , 2001, cond-mat/0108393.

[9]  Flavia Pennini,et al.  Rènyi entropies and Fisher informations as measures of nonextensivity in a Tsallis setting , 1998 .

[10]  B. Frieden,et al.  Physics from Fisher Information: A Unification , 1998 .

[11]  Hideo Hasegawa,et al.  Dynamical mean-field theory of spiking neuron ensembles: response to a single spike with independent noises. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[13]  Irene A. Stegun,et al.  Handbook of Mathematical Functions. , 1966 .

[14]  Celia Anteneodo,et al.  Multiplicative noise: A mechanism leading to nonextensive statistical mechanics , 2002 .

[15]  Hideo Hasegawa.  Stationary and dynamical properties of finite N-unit Langevin models subjected to multiplicative noises , 2007 .

[16]  Kwok Sau Fa,et al.  Linear Langevin equation with time-dependent drift and multiplicative noise term: exact study , 2003 .

[17]  M. Masi.  Generalized information-entropy measures and Fisher information , 2006, cond-mat/0611300.

[18]  A. Ohara.  Geometry of distributions associated with Tsallis statistics and properties of relative entropy minimization , 2007 .

[19]  Tsallis,et al.  Anomalous diffusion in the presence of external forces: Exact time-dependent solutions and their thermostatistical basis. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[20]  F. Pennini,et al.  Power-law distributions and Fisher's information measure , 2004 .

[21]  Hideo Hasegawa,et al.  Dynamics of the Langevin model subjected to colored noise: Functional-integral method , 2007, 0708.2563.

[22]  Nonequilibrium stochastic processes: time dependence of entropy flux and entropy production. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  A. Plastino,et al.  The nonlinear Fokker-Planck equation with state-dependent diffusion - a nonextensive maximum entropy approach , 1999 .

[24]  A. R. Plastino,et al.  A nonextensive maximum entropy approach to a family of nonlinear reaction–diffusion equations , 2000 .

[25]  C. Tsallis.  Possible generalization of Boltzmann-Gibbs statistics , 1988 .

[26]  I. Csiszár.  A class of measures of informativity of observation channels , 1972 .

[27]  F. Pennini,et al.  Geometrical aspects of a generalized statistical mechanics , 2007 .

[28]  A. R. Plastino,et al.  Non-extensive statistical mechanics and generalized Fokker-Planck equation , 1995 .

[29]  Sumiyoshi Abe.  Geometry of escort distributions. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Hideo Hasegawa.  N-Dependent Multiplicative-Noise Contributions in Finite N-Unit Langevin Models: Augmented Moment Approach , 2006 .

[31]  B. Frieden,et al.  Physics from Fisher Information by B. Roy Frieden , 1998 .

[32]  A. Plastino,et al.  Tsallis nonextensive thermostatistics and Fisher's information measure , 1997 .

[33]  B. Ai,et al.  Correlated noise in a logistic growth model. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Nonextensive aspects of small-world networks , 2005, cond-mat/0506301.

[35]  J. García-Ojalvo,et al.  Effects of noise in excitable systems , 2004 .

[36]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[37]  Grégoire Nicolis,et al.  ENTROPY PRODUCTION AND PHASE SPACE VOLUME CONTRACTION , 1999 .

[38]  B C Bag,et al.  Noise properties of stochastic processes and entropy production. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Estimators, escort probabilities, and phi-exponential families in statistical physics , 2004, math-ph/0402005.

[40]  A. Plastino,et al.  Information measures based on Tsallis’ entropy and geometric considerations for thermodynamic systems , 2005, cond-mat/0510434.

[41]  A. d’Onofrio.  Fractal growth of tumors and other cellular populations: Linking the mechanistic to the phenomenological modeling and vice versa , 2009, 1309.3329.