Artifical neural networks as subsymbolic process descriptors

Hydroinformatics proceeds into that which M.B. Abbott has characterised as the 'post-symbolic' era along two different paths. Along the one path, it elaborâtes tools and even more generai working environments for engineers, environmentalists and other Professionals that make little or no use of symbols in any conventional sense, but which instead work almost entirely with signs. Along the other path, as illustrated in this present work, hydroinformatics increasingly uses non-symbolic, and indeed strictly sub-symbolic, methods in order to construct these tools and more generai working environments. Of course, in this latter case, the constructor of these instruments must still make recourse to symbolic representations, but, as explained here, these are employed essentially as aids to the thinking processes of the constructor, and are not carried over or incorporated in any way into the operations of the constructions themselves. It is this second path of sub-symbolic constructions that forms the subject of the present work. The first chapter of this work is given over to an introduction to the sub-symbolic paradigm in generai and within the particular context of hydroinformatics. The three main current divisions within the sub-symbolic paradigm are those of artificial neural networks (ANNs), evolutionary algorithms and cellular automata. A detailed description of artificial neural networks and, in particular, feed-forward, multi-layer perceptrons, which constitute the sub-symbolic tool used throughout this work, is given in Chapter 2. A brief description of the other two sub-symbolic methodologies is given in Chapter 3. In Chapter 4, ANNs are used to model the rainfall-runoff process using artificially-generated data, laboratory-experimental data and real, measured-catchment data to an exceptionally high degree of accuracy. The problem of extrapolation is described and a possible solution is posed for this problem. In Chapter 5, ANNs are applied to the problem of finding an accurate and stable solution of the pure advection equation. The resulting ANNs provide results that are at least as good as those obtained by more traditional numerical methods. Finally, in Chapter 6, ANNs are applied to the more generai problem of data mining as exemplified by rainfall-runoff modelling, sait intrusion and sediment transportation. It is shown that the A N N outperforms more traditional, essentially manual, methods of data mining, and also provides significantly more accurate results than those obtained by another sub-symbolic paradigm, namely that of genetic programming.

[1]  Jason Smith,et al.  Neural-Network Models of Rainfall-Runoff Process , 1995 .

[2]  A. W. Minns,et al.  Artificial neural networks as rainfall-runoff models , 1996 .

[3]  M. Abbott Computational Hydraulics: Elements of the Theory of Free Surface Flows , 1979 .

[4]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Frisch,et al.  Lattice gas automata for the Navier-Stokes equations. a new approach to hydrodynamics and turbulence , 1989 .

[6]  A. W. Minns,et al.  Hydrological Modelling in a Hydroinformatics Context , 1990 .

[7]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[8]  Witold F. Krajewski,et al.  Rainfall forecasting in space and time using a neural network , 1992 .

[9]  J. A. Cunge,et al.  On The Subject Of A Flood Propagation Computation Method (Musklngum Method) , 1969 .

[10]  M. Radojković,et al.  Urban Drainage Catchments: Selected Worldwide Rainfall-Runoff Data from Experimental Catchments , 1986 .

[11]  John von Neumann,et al.  Theory Of Self Reproducing Automata , 1967 .

[12]  M. H. Diskin,et al.  A procedure for the selection of objective functions for hydrologic simulation models , 1977 .

[13]  Bernard Widrow,et al.  The basic ideas in neural networks , 1994, CACM.

[14]  Stewart W. Wilson ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[15]  M. Schaap,et al.  Modeling water retention curves of sandy soils using neural networks , 1996 .

[16]  Y. Pomeau,et al.  Lattice-gas automata for the Navier-Stokes equation. , 1986, Physical review letters.

[17]  S. Jørgensen Models in Ecology , 1975 .

[18]  K. G. Denbigh The Objectivity, or Otherwise, of the Present , 1978 .

[19]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[20]  W. E. Hart,et al.  A critique of current methods in hydrologic systems investigation , 1964 .

[21]  Arthur J. Askew,et al.  DERIVATION OF FORMULAE FOR VARIABLE LAG TIME , 1970 .

[22]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[23]  H. Savenije Predictive model for salt intrusion in estuaries , 1993 .

[24]  Allen Newell,et al.  Physical Symbol Systems , 1980, Cogn. Sci..

[25]  Eric Goles,et al.  Neural and automata networks , 1990 .

[26]  Vladan Babovic,et al.  The evolution of equations from hydraulic data Part II: Applications , 1997 .

[27]  Shie-Yui Liong,et al.  APPLICATION OF RORB MODEL TO A CATCHMENT IN SINGAPORE , 1987 .

[28]  Thomas Jackson,et al.  Neural Computing - An Introduction , 1990 .

[29]  P. Smolensky On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[30]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[31]  John Maynard Smith Models in ecology , 1974 .

[32]  Hubert H. G. Savenije,et al.  Composition and driving mechanisms of longitudinal tidal average salinity dispersion in estuaries , 1993 .

[33]  Jørgen Fredsøe,et al.  A Sediment Transport Model for Straight Alluvial Channels , 1976 .

[34]  J. Cunge,et al.  Practical aspects of computational river hydraulics , 1980 .

[35]  P. E. O'connell,et al.  An introduction to the European Hydrological System — Systeme Hydrologique Europeen, “SHE”, 2: Structure of a physically-based, distributed modelling system , 1986 .

[36]  C. Darwin The Origin of Species by Means of Natural Selection, Or, The Preservation of Favoured Races in the Struggle for Life , 1859 .

[37]  Don Johnstone,et al.  Elements of Applied Hydrology , 1949 .

[38]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[39]  John J. Hopfield,et al.  Neurons, Dynamics and Computation , 1994 .

[40]  J. H. Donald,et al.  Rule induction - machine learning techniques , 1994 .

[41]  C F Izzard,et al.  HYDRAULICS OF RUNOFF FROM DEVELOPED SURFACES , 1947 .

[42]  H. Savenije,et al.  Rapid assessment technique for salt intrusion in alluvial estuaries , 1992 .

[43]  M. Abbott Hydroinformatics: Information Technology and the Aquatic Environment , 1991 .

[44]  Jørgen Fredsøe,et al.  Data analysis of bed concentration of suspended sediment , 1994 .

[45]  R. K. Linsley,et al.  The relation between rainfall and runoff: Review paper , 1967 .

[46]  Michael B. Abbott,et al.  THE ELECTRONIC ENCAPSULATION OF KNOWLEDGE IN HYDRAULICS, HYDROLOGY AND WATER RESOURCES , 1993 .

[47]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[48]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry, Expanded Edition , 1987 .

[49]  J. Schwartz,et al.  Theory of Self-Reproducing Automata , 1967 .

[50]  Thomas A. McMahon,et al.  Simple Nonlinear Model for Flood Estimation , 1974 .

[51]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[52]  H. Einstein,et al.  The Bed-Load Function for Sediment Transportation in Open Channel Flows , 1950 .

[53]  M. B. Abbott,et al.  Commercial and scientific aspects of applied mathematical modelling , 1979 .

[54]  Paul A. Fishwick,et al.  Feedforward Neural Nets as Models for Time Series Forecasting , 1993, INFORMS J. Comput..

[55]  D. B. Simons,et al.  Summary of alluvial channel data from flume experiments, 1956-61 , 1966 .

[56]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[57]  E. Laurenson,et al.  A catchment storage model for runoff routing , 1964 .

[58]  Vladan Babovic,et al.  Emergence, evolution, intelligence: hydroinformatics , 1996 .

[59]  L. Brillouin,et al.  Science and information theory , 1956 .