The Greatest Common Quotient of Borel-Serre and the Toroidal Compactifications of Locally Symmetric Spaces