Refined qualitative analysis for a class of neural networks