What Decreases Editing Capability? Domain-Specific Hybrid Refinement for Improved GAN Inversion