Anyonic symmetries and topological defects in Abelian topological phases: An application to the A D E classification