Non-Markovian modeling of Fermi-Bose systems coupled to one or several Fermi-Bose thermal baths