Virtual Policy Networks: Where all Roads Lead to Rome