Characterizing linear groups in terms of growth properties