The Formation of Very Massive Stars in Early Galaxies and Implications for Intermediate Mass Black Holes