Curvature-Restored Gauge Invariance and Ultraviolet Naturalness