Broken symmetry in the boundary element method