Optimal control of multi-photon isotope separation using ultra-short intense laser pulses: Density operator theory