Clues for flavor from rare lepton and quark decays