On the rigidity of solitary waves for the focusing mass-critical NLS in dimensions d⩾2