High energy modular bootstrap, global symmetries and defects