Revisiting the conformally soft sector with celestial diamonds