Lattice Effects Across the Phase Diagram of Pnictides