Breakdown of the Weak-Coupling Limit in Quantum Annealing