Breaking of statistical isotropy and signatures of vector fields during inflation