Slow Cooling and Fast Reinflation for Hot Jupiters