Fermi’s golden rule, the origin and breakdown of Markovian master equations, and the relationship between oscillator baths and the random matrix model