A Theoretical Analysis of Neural Networks with Nonzero Diagonal Elements (Special Section on the 5th Karuizawa Workshop on Circuits and Systems)