The geometric phase controls ultracold chemistry