Luminescence properties of transition-metal-doped GaSb