On the deformation complex of homotopy affine actions