On finite extensions of arithmetic groups