Quantizations of conical symplectic resolutions II: category $\mathcal O$ and symplectic duality