Origin of oscillatory structures in the magnetothermal conductivity of the putative Kitaev magnet $\alpha$-RuCl$_3$