Generalised row and column removal phenomena and $p$-Kostka numbers