Finite-size prethermalization at the chaos-to-integrable crossover