Coherent dynamics and decoherence in a superconducting weak link