Plasma instabilities of a relativistically strong electromagnetic wave