Spin liquid regimes at nonzero temperature in quantum spin ice