Temperature dependent spin-phonon coupling of boron-vacancy centers in hexagonal boron nitride