Limits on New Physics from exclusive $B \to D^{(*)}\ell \bar\nu$ Decays