The public opinion about the EU can easily be swayed in different directions