Carrier thermometry of cold ytterbium atoms in an optical lattice clock