Endomorphisms of Semi-Stable Abelian Varieties Over Number Fields