Higher-order effects on the precision of clocks of neutral atoms in optical lattices