Operators, correlators and free fermions for SO(N) and Sp(N)