Large and Small Non-extremal Black Holes, Thermodynamic Dualities, and the Swampland