Search for sterile neutrinos with SOX: Monte Carlo studies of the experiment sensitivity and systematic effects