Brauer groups of moduli of hyperelliptic curves via cohomological invariants