Regression with Gaussian Processes: Average Case Performance

Recently, new models for regression and classification have been introduced which may be interpreted as neural networks in the limit of infinitely many parameters. For a regression model, the average case generalization performance is studied using a combination of information theoretic ideas and statistical mechanics methods.