Training, dynamics, and complexity of architecture-specific recurrent neural networks