Temporal breakdown and Borel resummation in the complex Langevin method