Final Compact Remnants in Core-collapse Supernovae from 20 to 40 M ⊙: The Lower Mass Gap