Polarization dependence of phonon influences in exciton-biexciton quantum dot systems