The Gemini Deep Deep Survey. VIII. When Did Early-Type Galaxies Form?