Gyrotropic Hall effect in Berry-curved materials