Being a Bit Frequentist Improves Bayesian Neural Networks