On the asymptotic regularity of a family of matrices