A New Abstract Combinatorial Dimension for Exact Learning via Queries

We introduce an abstract model of exact learning via queries that can be instantiated to all the query learning models currently in use, while being closer to them than previous unifying attempts. We present a characterization of those Boolean function classes learnable in this abstract model, in terms of a new combinatorial notion that we introduce, the abstract identification dimension. Then we prove that the particularization of our notion to specific known protocols such as equivalence, membership, and membership and equivalence queries results in exactly the same combinatorial notions currently known to characterize learning in these models, such as strong consistency dimension, extended teaching dimension, and certificate size. Our theory thus fully unifies all these characterizations. For models enjoying a specific property that we identify, the notion can be simplified while keeping the same characterizations. From our results we can derive combinatorial characterizations of all those other models for query learning proposed in the literature. We can also obtain the first polynomial-query learning algorithms for specific interesting problems such as learning DNF with proper subset and superset queries.

[1]  Ayumi Shinohara,et al.  Uniform characterizations of polynomial-query learnabilities , 1998, Theor. Comput. Sci..

[2]  N. V. VinodchandranInstitute The Complexity of Exactly Learning Algebraic Concepts , 1996 .

[3]  Sampath Kannan,et al.  Oracles and Queries That Are Sufficient for Exact Learning , 1996, J. Comput. Syst. Sci..

[4]  José L. Balcázar,et al.  The consistency dimension and distribution-dependent learning from queries , 2002, Theor. Comput. Sci..

[5]  Jorge Castro,et al.  Learning Nearly Monotone k-Term DNF , 1998, Inf. Process. Lett..

[6]  Ricard Gavaldà,et al.  On the power of equivalence queries , 1994, EuroCOLT.

[7]  Lisa Hellerstein,et al.  How many queries are needed to learn? , 1995, JACM.

[8]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[9]  Vikraman Arvind,et al.  The Complexity of Exactly Learning Algebraic Concepts. (Extended Abstract) , 1996, ALT.

[10]  Vijay Raghavan,et al.  Exact Learning when Irrelevant Variables Abound , 1999, Inf. Process. Lett..

[11]  Vikraman Arvind,et al.  Exact learning via teaching assistants , 2000, Theor. Comput. Sci..

[12]  Marek Karpinski,et al.  Learning read-once formulas using membership queries , 1989, COLT '89.

[13]  David Haussler,et al.  Learnability and the Vapnik-Chervonenkis dimension , 1989, JACM.

[14]  Wolfgang Maass,et al.  On the complexity of learning from counterexamples and membership queries , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[15]  José L. Balcázar,et al.  The Consistency Dimension and Distribution-Dependent Learning from Queries (Extended Abstract) , 1999, ALT.

[16]  L. Pitt,et al.  On the Learnability of Disjunctive Normal Form Formulas , 1995, Machine Learning.

[17]  Wolfgang Maass,et al.  On the complexity of learning from counterexamples , 1989, 30th Annual Symposium on Foundations of Computer Science.

[18]  Stephen Kwek,et al.  Learning from examples with unspecified attribute values , 2003, Inf. Comput..

[19]  Dana Angluin,et al.  Queries and concept learning , 1988, Machine Learning.

[20]  Tibor Hegedüs,et al.  Generalized Teaching Dimensions and the Query Complexity of Learning , 1995, COLT.

[21]  Michael Kearns,et al.  On the complexity of teaching , 1991, COLT '91.