Non-normal dynamics of co-rotating vortex pairs