System for normalization of a hamiltonian function based on lie series