The 2PM Hamiltonian for binary Kerr to quartic in spin