Gauge fields and inflation: Chiral gravitational waves, fluctuations, and the Lyth bound