PRIMUS: THE DEPENDENCE OF AGN ACCRETION ON HOST STELLAR MASS AND COLOR