Intertwining automorphisms in finite incidence structures