Constructing General Unitary Maps from State Preparations