A note on a gap result for norms of semigroups of matrices