Interaction of relativistic electron beam and an electromagnetic field in oversize periodic waveguide near the high-frequency limit of bandpass