From Hessian to Weitzenböck: manifolds with torsion-carrying connections