Challenges in identifying chiral spin textures via the topological Hall effect