Taming the Leibniz rule on the lattice