Introduction to Neural Networks

A neuron is a simple computing element and a neural network is an interconnection of such computing elements [2,3]. In this chapter, we review an electrical model of the neuron, analyze the mechanism of computing in a network of such neurons and show that this computation is equivalent to the minimization of a certain cost function known as the energy of the network [1]. We also review a possible implementation of a neuron as an analog circuit and discuss general techniques to construct neural networks for combinatorial optimization problems.