Impurity Effect on the Stability of the Ground-State Spin Configuration in Triangular Lattice Antiferromagnet CuFeO2