Fuzziness, Probability, Uncertainty and the Foundations of Knowledge

This paper will describe how fuzzy logic, neural networks and other fundamental approaches to the nature of knowledge and epistemology fit together, both at a philosophical level and at the level of practical technology. The views herein are my own, but the bulk of the credit really belongs to Lotfi Zadeh and to the unusual, rich dialogue he has created through the Berkeley Initiative for Soft Computing (BISC). Only this very special kind of dialogue can really bring out the many cross-connections which exist in these complex fields of research. Lotfi has done an amazing job of pushing the community just hard enough, through clear but tricky questions, to get ever deeper into a wide range of issues related to fuzzy logic and to soft computing in general.

[1]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[2]  K. Deutsch,et al.  Nationalism and Social Communication , 1954 .

[3]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[4]  T. Wonnacott,et al.  Introductory statistics for business and economics , 1972 .

[5]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[6]  C. Morris.  Parametric Empirical Bayes Inference: Theory and Applications , 1983 .

[7]  K. Gödel.  Philosophy of mathematics: Russell's mathematical logic , 1984 .

[8]  Paul J. Werbos,et al.  Building and Understanding Adaptive Systems: A Statistical/Numerical Approach to Factory Automation and Brain Research , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Paul J. Werbos,et al.  2.1. Econometric techniques: Theory versus practice , 1990 .

[10]  P. Werbos.  1.5. Rational approaches to identifying policy objectives , 1990 .

[11]  James S. Albus,et al.  Outline for a theory of intelligence , 1991, IEEE Trans. Syst. Man Cybern..

[12]  A. Barron.  Approximation and Estimation Bounds for Artificial Neural Networks , 1991, COLT '91.

[13]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[14]  Paul J. Werbos,et al.  Elastic Fuzzy Logic: A Better Fit to Neurocontrol and True Intelligence , 1993, J. Intell. Fuzzy Syst..

[15]  Barbara Hayes-Roth,et al.  Intelligent Control , 1994, Artif. Intell..

[16]  Paul J. Werbos,et al.  The Roots of Backpropagation: From Ordered Derivatives to Neural Networks and Political Forecasting , 1994 .

[17]  Jose C. Principe,et al.  Neural and adaptive systems : fundamentals through simulations , 2000 .

[18]  D.B. Fogel,et al.  A self-learning evolutionary chess program , 2004, Proceedings of the IEEE.

[19]  Warren B. Powell,et al.  Handbook of Learning and Approximate Dynamic Programming , 2006, IEEE Transactions on Automatic Control.

[20]  P. Werbos.  Backwards Differentiation in AD and Neural Nets: Past Links and New Opportunities , 2006 .

[21]  Martin Bücker,et al.  Automatic differentiation : applications, theory, and implementations , 2006 .

[22]  Robert Kozma,et al.  Beyond Feedforward Models Trained by Backpropagation: A Practical Training Tool for a More Efficient Universal Approximator , 2007, IEEE Transactions on Neural Networks.

[23]  Danil V. Prokhorov,et al.  Toyota Prius HEV neurocontrol and diagnostics , 2008, Neural Networks.

[24]  P. Werbos.  Bell’s Theorem, Many Worlds and Backwards-Time Physics: Not Just a Matter of Interpretation , 2008, 0801.1234.

[25]  Paul J. Werbos,et al.  2009 Special Issue: Intelligence in the brain: A theory of how it works and how to build it , 2009 .

[26]  I. Johnstone,et al.  Statistical challenges of high-dimensional data , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[27]  Yan Liu,et al.  Applications of Neural Networks in High Assurance Systems , 2010, Applications of Neural Networks in High Assurance Systems.

[28]  Paul J. Werbos,et al.  Neural networks and the experience and cultivation of mind , 2012, Neural Networks.

[29]  Jiaqi Liang,et al.  Wide-area measurement based dynamic stochastic optimal power flow control for smart grids with high variability and uncertainty , 2012, 2012 IEEE Power and Energy Society General Meeting.

[30]  Frank L. Lewis,et al.  Reinforcement Learning and Approximate Dynamic Programming for Feedback Control , 2012 .

[31]  P. Werbos.  Solitons for Describing 3-D Physical Reality:. the Current Frontier , 2013 .

[32]  Jerry M. Mendel,et al.  IEEE Press Series on Computational Intelligence , 2014 .