SU(2)-symmetric spin-boson model: Quantum criticality, fixed-point annihilation, and duality