A combined model for decay of the giant dipole resonance