Discovery of a Set of Nominally Conditioned Polynomials

This paper shows that a connectionist law discovery method called RF6 can discover a law in the form of a set of nominally conditioned polynomials, from data containing both nominal and numeric values. RF6 learns a compound of nominally conditioned polynomials by using single neural networks, and selects the best one among candidate networks, and decomposes the selected network into a set of rules. Here a rule means a nominally conditioned polynomial. Experiments showed that the proposed method works well in discovering such a law even from data containing irrelevant variables and a small amount of noise.

[1]  Kazumi Saito,et al.  Computational Characteristics of Law Discovery Using Neural Networks , 1998, Discovery Science.

[2]  Jan M. Zytkow,et al.  Combining many searches in the FAHRENHEIT discovery system , 1987 .

[3]  Cullen Schaffer.  Bivariate Scientific Function Finding in a Sampled, Real-Data Testbed , 1993, Mach. Learn..

[4]  Kazumi Saito,et al.  Partial BFGS Update and Efficient Step-Length Calculation for Three-Layer Neural Networks , 1997, Neural Computation.

[5]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[6]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[7]  David E. Rumelhart,et al.  Product Units: A Computationally Powerful and Biologically Plausible Extension to Backpropagation Networks , 1989, Neural Computation.

[8]  Kazumi Saito,et al.  Second-Order Learning Algorithm with Squared Penalty Term , 1996, Neural Computation.

[9]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[10]  Herbert A. Simon,et al.  Scientific discovery: compulalional explorations of the creative process , 1987 .

[11]  Philip E. Gill,et al.  Practical optimization , 1981 .

[12]  C. Lee Giles,et al.  Learning with Product Units , 1994, NIPS.

[13]  Pat Langley,et al.  An integrated framework for empirical discovery , 1993, Machine Learning.

[14]  Ryszard S. Michalski,et al.  Integrating Quantitative and Qualitative Discovery: The ABACUS System , 1990, Machine Learning.

[15]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[16]  David W. Aha,et al.  Instance‐based prediction of real‐valued attributes , 1989, Comput. Intell..

[17]  Kazumi Saito,et al.  Law Discovery using Neural Networks , 1997, IJCAI.