The three-loop polarized singlet anomalous dimensions from off-shell operator matrix elements