Health Secretary Milburn refuses to renegotiate contract