Early growth of typical high-redshift black holes seeded by direct collapse