Many-body interferometry of magnetic polaron dynamics