On the complexity of approximating the VC dimension

We study the complexity of approximating the VC dimension of a collection of sets, when the sets are encoded succinctly by a small circuit. We show that this problem is: /spl Sigma//sub 3//sup p/-hard to approximate to within a factor 2-/spl epsiv/ for any /spl epsiv/>0; approximable in A/spl Mscr/ to within a factor 2; and A/spl Mscr/-hard to approximate to within a factor N/sup /spl epsiv// for some constant /spl epsiv/>0. To obtain the /spl Sigma//sub 3//sup 9/-hardness results we solve a randomness extraction problem using list-decodable binary codes; for the positive results we utilize the Sauer-Shelah(-Perles) Lemma. The exact value of /spl epsiv/ in the A/spl Mscr/-hardness result depends on the degree achievable by explicit disperser constructions.

[1]  Amnon Ta-Shma,et al.  Extractors from Reed-Muller codes , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[2]  Marcus Sch afer.  Deciding the Vapnik-Cervonenkis dimension is Sigma_3^P-complete , 1995 .

[3]  Oded Goldreich,et al.  The Bit Extraction Problem of t-Resilient Functions (Preliminary Version) , 1985, FOCS.

[4]  Carsten Lund,et al.  On the hardness of approximating minimization problems , 1994, JACM.

[5]  C. Umans.  Hardness of Approximating Minimization Problems , 1999, FOCS 1999.

[6]  Nathan Linial,et al.  The influence of variables on Boolean functions , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[7]  Venkatesan Guruswami,et al.  Expander-based constructions of efficiently decodable codes , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[8]  Michael Sipser,et al.  Expanders, Randomness, or Time versus Space , 1988, J. Comput. Syst. Sci..

[9]  Noam Nisan,et al.  Extracting Randomness: A Survey and New Constructions , 1999, J. Comput. Syst. Sci..

[10]  K. Ko,et al.  On the Complexity of Min-Max Optimization Problems and their Approximation , 1995 .

[11]  S. Shelah.  A combinatorial problem; stability and order for models and theories in infinitary languages. , 1972 .

[12]  Marcus Schaefer,et al.  Deciding the Vapnik-Červonenkis Dimension in ∑p3-Complete , 1999, J. Comput. Syst. Sci..

[13]  Mihir Bellare,et al.  Free Bits, PCPs, and Nonapproximability-Towards Tight Results , 1998, SIAM J. Comput..

[14]  Nathan Linial,et al.  Results on learnability and the Vapnik-Chervonenkis dimension , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[15]  P. Pardalos,et al.  Minimax and applications , 1995 .

[16]  Umesh V. Vazirani,et al.  Strong communication complexity or generating quasi-random sequences from two communicating semi-random sources , 1987, Comb..

[17]  de Ng Dick Bruijn.  A combinatorial problem , 1946 .

[18]  Noga Alon,et al.  On the density of sets of vectors , 1983, Discret. Math..

[19]  Christopher Umans,et al.  Simple extractors for all min-entropies and a new pseudo-random generator , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[20]  László Babai,et al.  Arthur-Merlin Games: A Randomized Proof System, and a Hierarchy of Complexity Classes , 1988, J. Comput. Syst. Sci..

[21]  Norbert Sauer,et al.  On the Density of Families of Sets , 1972, J. Comb. Theory A.

[22]  Gilles Brassard,et al.  Privacy Amplification by Public Discussion , 1988, SIAM J. Comput..

[23]  Venkatesan Guruswami,et al.  List decoding algorithms for certain concatenated codes , 2000, STOC '00.

[24]  Mihalis Yannakakis,et al.  On Limited Nondeterminism and the Complexity of the V-C Dimension , 1996, J. Comput. Syst. Sci..

[25]  Amnon Ta-Shma,et al.  Loss-less condensers, unbalanced expanders, and extractors , 2001, STOC '01.

[26]  Oded Goldreich,et al.  The bit extraction problem or t-resilient functions , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[27]  Mihir Bellare,et al.  Free bits, PCPs and non-approximability-towards tight results , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[28]  Mark G. Karpovsky,et al.  Coordinate density of sets of vectors , 1978, Discret. Math..