Interference effects in angular streaking with a rotating terahertz field