Feedforward networks with monotone constraints
暂无分享,去创建一个
In many practical applications of artificial neural networks (ANN), there exist natural constraints on the model such as monotonic relations between inputs and outputs that are known in advance. It is advantageous to incorporate these constraints into the ANN structure. We propose a modified feedforward network structure that enforces monotonic relations on designated input variables. The backpropagation formulas for the gradients in the new network structure are derived which lead to various learning algorithms. The monotone properties and the backpropagation formulas for the networks are proven mathematically and verified with numerical examples. A computer program for the new network structure and a learning algorithm is implemented to test the system. Experimental results are obtained on both simulated and real data sets.
[1] R. Fletcher. Practical Methods of Optimization , 1988 .
[2] M. Hestenes,et al. Methods of conjugate gradients for solving linear systems , 1952 .
[3] A W Partin,et al. Combination of prostate-specific antigen, clinical stage, and Gleason score to predict pathological stage of localized prostate cancer. A multi-institutional update. , 1997, JAMA.