Asymmetric Structure of the Solar Wind and Heliosphere from IBEX Observations