Neural Networks and Unconstrained Optimization

When performing the unconstrained optimisation of a complicated industrial problem, the main computational time is usually spent in the calculation of the objective function and its derivatives. The calculation of the objective function is usually performed sequentially, so if a parallel processing machine is to be used, then either a number of function evaluations must be calculated in parallel or the sequential calculation of the objective function replaced by a parallel calculation.