Centers of higher degree trace forms