A systematic search for near-infrared counterparts of nearby ultraluminous X-ray sources (II)