Manifest duality for partially massless higher spins