Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change