Non-adiabatic Hall effect at Berry curvature hot spot