On the Spectra and Pseudospectra of a Class of Non-Self-Adjoint Random Matrices and Operators