Grisvard's shift theorem near L^infinity and Yudovich theory on polygonal domains