S-functions, spectral functions of hyperbolic geometry, and vertex operators with applications to structure for Weyl and orthogonal group invariants