Transfer operator for the Gauss' continued fraction map. I. Structure of the eigenvalues and trace formulas