Vortices in quantum droplets: Analogies between boson and fermion systems