Perceptron and Neural Networks

In this chapter we will study the classical theory of neural networks based on multilayer perceptron. We will learn the architecture of the neural networks and feedforward operation. We will learn about the activation functions and their importance. We will learn different methods to train the neural networks and compare their advantages and disadvantages. Then we will see different type of architecture in the form of radial basis function networks and understand their conceptual interpretation. Then we will conclude the chapter with concepts of overfitting and regularization.