Topological birefringence and combined Rytov-Magnus effect