The Effects of Primordial Black Holes on Dark Matter Models