Improvement on the manipulation of a single nitrogen-vacancy spin and microwave photon at single-quantum level