Torsion-Free Modules with Nearly Unique Endomorphism Algebras