Switching of Hybrid Improper Ferroelectricity in Oxide Double Perovskites