A neural network construction algorithm with application to image compression

We propose an algorithm for constructing a feedforward neural network with a single hidden layer. This algorithm is applied to image compression and it is shown to give satisfactory results. The neural network construction algorithm begins with a simple network topology containing a single unit in the hidden layer. An optimal set of weights for this network is obtained by applying a variant of the quasi-Newton method for unconstrained optimisation. If this set of weights does not give a network with the desired accuracy then one more unit is added to the hidden layer and the network is retrained. This process is repeated until the desired network is obtained. We show that each addition of the hidden unit to the network is guaranteed to increase the signal to noise ratio of the compressed image.