Effect of Oxygen-Deficiency of CuO2 Plane on the Structure, Magnetism, and Transport Properties