Screening interacting factors in a wireless network testbed using locating arrays

Wireless systems exhibit a wide range of configurable parameters (factors), each with a number of values (levels), that may influence performance. Exhaustively analyzing all factor interactions is typically not feasible in experimental systems due to the large design space. We propose a method for determining which factors play a significant role in wireless network performance with multiple performance metrics (response variables). Such screening can be used to reduce the set of factors in subsequent experimental testing, whether for modelling or optimization. Our method accounts for pairwise interactions between the factors when deciding significance, because interactions play a significant role in real-world systems. We utilize locating arrays to design the experiment because they guarantee that each pairwise interaction impacts a distinct set of tests. We formulate the analysis as a problem in compressive sensing that we solve using a variation of orthogonal matching pursuit, together with statistical methods to determine which factors are significant. We evaluate the method using data collected from the w-iLab.t Zwijnaarde wireless network testbed and construct a new experiment based on the first analysis to validate the results. We find that the analysis exhibits robustness to noise and to missing data.

[1]  Ingrid Moerman,et al.  Efficient global optimization of multi-parameter network problems on wireless testbeds , 2015, Ad Hoc Networks.

[2]  Steven G. Gilmour,et al.  Factor Screening via Supersaturated Designs , 2006 .

[3]  Ingrid Moerman,et al.  Efficient Identification of a Multi-Objective Pareto Front on a Wireless Experimentation Facility , 2016, IEEE Transactions on Wireless Communications.

[4]  H.C.S. Rughooputh,et al.  OFDM Systems Resource Allocation using Multi- Objective Particle Swarm Optimization , 2012 .

[5]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[6]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[7]  B. P. Murphy,et al.  Handbook of Methods of Applied Statistics , 1968 .

[8]  Runze Li,et al.  Analysis Methods for Supersaturated Design: Some Comparisons , 2003, Journal of Data Science.

[9]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[10]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[11]  Welch Bl THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED , 1947 .

[12]  Charles J. Colbourn,et al.  Locating and detecting arrays for interaction faults , 2008, J. Comb. Optim..

[13]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[14]  Stefan Bouckaert,et al.  The w-iLab.t Testbed , 2010, TRIDENTCOM.

[15]  Chip Elliott,et al.  GENI - global environment for network innovations , 2008, LCN.

[16]  Tuan Anh Le,et al.  Fundamental performance trade-offs in coexisting wireless networks , 2014, 1st International Conference on 5G for Ubiquitous Connectivity.

[17]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[18]  Charles J. Colbourn,et al.  Locating Arrays: A New Experimental Design for Screening Complex Engineered Systems , 2015, OPSR.