Reduction of manifolds with semi-negative holomorphic sectional curvature