Primordial black holes from inflationary models with and without broken scale invariance