Arithmetic representations of fundamental groups, II: Finiteness