Heterotic/type I duality and D-brane instantons