Importance of Giant Impact Ejecta for Orbits of Planets Formed during the Giant Impact Era