Jack and Masters of All Trades: One-Pass Learning of a Set of Model Sets from Foundation Models