Towards azimuthal anisotropy of direct photons