Going out with a bang: compact object collisions resulting from supernovae in binary systems