L1 normalisation in neural networks using parallel automatic level control

A simple circuit that performs L1 normalisation of positive-valued parallel inputs is proposed. It can be utilised to implement ‘on-line’ normalisation of input patterns or weight vectors in neural networks based on competitive learning mechanisms. A modified scheme with high linearity is also presented.