Experimental and simulated studies for the calibration of a radioactive waste assay system