Moving away from singly-magic nuclei with Gorkov Green’s function theory