Domain wall trajectory determined by its fractional topological edge defects