Automorphism groups of rigid affine surfaces: the identity component