Kinetic Theory of Phase Space Vortices and Double Layers