Holographic renormalization for irrelevant operators and multi-trace counterterms