On Exhaustive Learning