Lower Bounds for Testing Properties of Functions over Hypergrid Domains

We show how the communication complexity method introduced in (Blais, Brody, Matulef 2012) can be used to prove lower bounds on the number of queries required to test properties of functions with non-hypercube domains. We use this method to prove strong, and in many cases optimal, lower bounds on the query complexity of testing fundamental properties of functions f : {1, . . ., n}d → ℝ over hypergrid domains: monotonicity, the Lipschitz property, separate convexity, convexity and monotonicity of higher-order derivatives. There is a long line of work on upper bounds and lower bounds for many of these properties that uses a diverse set of combinatorial techniques. Our method provides a unified treatment of lower bounds for all these properties based on Fourier analysis. A key ingredient in our new lower bounds is a set of Walsh functions, a canonical Fourier basis for the set of functions on the line {1, . . ., n}. The orthogonality of the Walsh functions lets us use a product construction to extend our method from properties of functions over the line to properties of functions over hypergrids. Our product construction applies to properties over hypergrids that can be expressed in terms of axis-parallel directional derivatives, such as monotonicity, the Lipschitz property and separate convexity. We illustrate the robustness of our method by making it work for convexity, which is the property of the Hessian matrix of second derivatives being positive semidefinite and thus cannot be described by axis-parallel directional derivatives alone. Such robustness contrasts with the state of the art in the upper bounds for testing properties over hypergrids: methods that work for other properties are not applicable for testing convexity, for which no nontrivial upper bounds are known for d ≥ 2.

[1]  Seshadhri Comandur,et al.  Property Testing on Product Distributions: Optimal Testers for Bounded Derivative Properties , 2015, SODA.

[2]  Oded Goldreich,et al.  Property Testing - Current Research and Surveys , 2010, Property Testing.

[3]  Dana Ron,et al.  Improved Testing Algorithms for Monotonicity , 1999, Electron. Colloquium Comput. Complex..

[4]  Pooya Hatami Lower Bounds on Testing Functions of Low Fourier Degree , 2012, ArXiv.

[5]  Seshadhri Comandur,et al.  A o(n) monotonicity tester for boolean functions over the hypercube , 2013, STOC '13.

[6]  Ronitt Rubinfeld,et al.  Spot-checkers , 1998, STOC '98.

[7]  Luc Tartar,et al.  Some Remarks on Separately Convex Functions , 1993 .

[8]  Venkatesh Medabalimi Property Testing Lower Bounds via Communication Complexity , 2012 .

[9]  Sofya Raskhodnikova,et al.  Testing and Reconstruction of Lipschitz Functions with Applications to Data Privacy , 2013, SIAM J. Comput..

[10]  MICHAL PARNAS,et al.  On Testing Convexity and Submodularity , 2002, SIAM J. Comput..

[11]  S. Hart,et al.  Bi-convexity and bi-martingales , 1986 .

[12]  Dana Ron,et al.  Property testing and its connection to learning and approximation , 1998, JACM.

[13]  Dana Ron,et al.  Algorithmic and Analysis Techniques in Property Testing , 2010, Found. Trends Theor. Comput. Sci..

[14]  Seshadhri Comandur,et al.  An Optimal Lower Bound for Monotonicity Testing over Hypergrids , 2013, APPROX-RANDOM.

[15]  Joshua Brody,et al.  Lower Bounds for Testing Computability by Small Width OBDDs , 2011, TAMC.

[16]  Santosh S. Vempala,et al.  Testing Geometric Convexity , 2004, FSTTCS.

[17]  Elena Grigorescu,et al.  Tight Lower Bounds for Testing Linear Isomorphism , 2013, APPROX-RANDOM.

[18]  Kyomin Jung,et al.  Transitive-Closure Spanners , 2008, SIAM J. Comput..

[19]  Sofya Raskhodnikova,et al.  Testing Lipschitz Functions on Hypergrid Domains , 2012, Algorithmica.

[20]  Jirí Matousek,et al.  On Functional Separately Convex Hulls , 1998, Discret. Comput. Geom..

[21]  Dana Ron,et al.  Property Testing , 2000 .

[22]  Sofya Raskhodnikova,et al.  Approximate Testing of Visual Properties , 2003, RANDOM-APPROX.

[23]  Eldar Fischer On the strength of comparisons in property testing , 2004, Inf. Comput..

[24]  Ronitt Rubinfeld,et al.  Monotonicity testing over general poset domains , 2002, STOC '02.

[25]  Ronitt Rubinfeld,et al.  Robust Characterizations of Polynomials with Applications to Program Testing , 1996, SIAM J. Comput..

[26]  Dana Ron,et al.  Testing Monotonicity , 2000, Comb..

[27]  Oded Goldreich On the Communication Complexity Methodology for Proving Lower Bounds on the Query Complexity of Property Testing , 2013, Electron. Colloquium Comput. Complex..

[28]  Jan Vondrák,et al.  Is Submodularity Testable? , 2010, Algorithmica.

[29]  Seshadhri Comandur,et al.  Optimal bounds for monotonicity and lipschitz testing over hypercubes and hypergrids , 2013, STOC '13.

[30]  Seshadhri Comandur,et al.  An Optimal Lower Bound for Monotonicity Testing over Hypergrids , 2014, Theory Comput..

[31]  Bernard Chazelle,et al.  Information theory in property testing and monotonicity testing in higher dimension , 2006, Inf. Comput..

[32]  Jirí Matousek On directional convexity , 2001, Discret. Comput. Geom..

[33]  Joshua Brody A Tight Lower Bound for Monotonicity Testing over Large Ranges , 2013, ArXiv.

[34]  Ronitt Rubinfeld,et al.  Sublinear Time Algorithms , 2011, SIAM J. Discret. Math..

[35]  Sofya Raskhodnikova,et al.  Learning pseudo-Boolean k-DNF and submodular functions , 2013, SODA.

[36]  Ronitt Rubinfeld,et al.  Spot-Checkers , 2000, J. Comput. Syst. Sci..

[37]  Peter Bro Miltersen,et al.  On data structures and asymmetric communication complexity , 1994, STOC '95.

[38]  Sofya Raskhodnikova,et al.  Lp-testing , 2014, STOC.

[39]  Sofya Raskhodnikova,et al.  Testing the Lipschitz Property over Product Distributions with Applications to Data Privacy , 2013, TCC.