Interplay of dust alignment, grain growth and magnetic fields in polarization: lessons from the emission-to-extinction ratio