Recovering all generalized order-preserving submatrices: new exact formulations and algorithms

Cluster analysis of gene expression data is a popular and successful way of elucidating underlying biological processes. Typically, cluster analysis methods seek to group genes that are differentially expressed across experimental conditions. However, real biological processes often involve only a subset of genes and are activated in only a subset of environmental or temporal conditions. To address this limitation, Ben-Dor et al. (J Comput Biol 10(3–4):373–384, 2003) developed an approach to identify order-preserving submatrices (OPSMs) in which the expression levels of included genes induce the sample linear ordering of experiments. In addition to gene expression analysis, OPSMs have application to recommender systems and target marketing. While the problem of finding the largest OPSM is $${{\mathscr {N}}}{{\mathscr {P}}}$$NP-hard, there have been significant advances in both exact and approximate algorithms in recent years. Building upon these developments, we provide two exact mathematical programming formulations that generalize the OPSM formulation by allowing for the reverse linear ordering, known as the generalized OPSM pattern, or GOPSM. Our formulations incorporate a constraint that provides a margin of safety against detecting spurious GOPSMs. Finally, we provide two novel algorithms to recover, for any given level of significance, all GOPSMs from a given data matrix, by iteratively solving mathematical programming formulations to global optimality. We demonstrate the computational performance and accuracy of our algorithms on real gene expression data sets showing the capability of our developments.

[1]  Hui Xiong,et al.  On the Deep Order-Preserving Submatrix Problem: A Best Effort Approach , 2012, IEEE Transactions on Knowledge and Data Engineering.

[2]  Egor V. Kostylev,et al.  Classification of annotation semirings over containment of conjunctive queries , 2014, ACM Trans. Database Syst..

[3]  David Wai-Lok Cheung,et al.  Mining Order-Preserving Submatrices from Data with Repeated Measurements , 2013, IEEE Trans. Knowl. Data Eng..

[4]  Richard M. Karp,et al.  Discovering local structure in gene expression data: the order-preserving submatrix problem , 2002, RECOMB '02.

[5]  Jennifer Y. King,et al.  Pathway analysis of coronary atherosclerosis. , 2005, Physiological genomics.

[6]  Michael Ruogu Zhang,et al.  Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. , 1998, Molecular biology of the cell.

[7]  Obi L. Griffith,et al.  Discovering significant OPSM subspace clusters in massive gene expression data , 2006, KDD '06.

[8]  Thomas Gärtner,et al.  A Fixed Parameter Tractable Integer Program for Finding the Maximum Order Preserving Submatrix , 2011, 2011 IEEE 11th International Conference on Data Mining.

[9]  Oleg A. Prokopyev,et al.  Solving the Order-Preserving Submatrix Problem via Integer Programming , 2010, INFORMS J. Comput..

[10]  Obi L. Griffith,et al.  KiWi: A Scalable Subspace Clustering Algorithm for Gene Expression Analysis , 2009, 2009 3rd International Conference on Bioinformatics and Biomedical Engineering.

[11]  Dorit S. Hochbaum,et al.  Approximation Algorithms for a Minimization Variant of the Order-Preserving Submatrices and for Biclustering Problems , 2013, TALG.

[12]  Wilfred Ng,et al.  Mining order-preserving submatrices from probabilistic matrices , 2014, TODS.

[13]  Wilfred Ng,et al.  Mining Bucket Order-Preserving SubMatrices in Gene Expression Data , 2012, IEEE Transactions on Knowledge and Data Engineering.

[14]  David P. Woodruff,et al.  Optimal Bounds for Johnson-Lindenstrauss Transforms and Streaming Problems with Subconstant Error , 2011, TALG.

[15]  Arlindo L. Oliveira,et al.  Biclustering algorithms for biological data analysis: a survey , 2004, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[16]  E. Lander,et al.  Remodeling of yeast genome expression in response to environmental changes. , 2001, Molecular biology of the cell.

[17]  R. Myers,et al.  Comprehensive analysis of transcriptional promoter structure and function in 1% of the human genome. , 2005, Genome research.

[18]  Wei Wang,et al.  Mining Approximate Order Preserving Clusters in the Presence of Noise , 2008, 2008 IEEE 24th International Conference on Data Engineering.

[19]  Sau Dan Lee,et al.  Mining Order-Preserving Submatrices from Data with Repeated Measurements , 2008, IEEE Transactions on Knowledge and Data Engineering.

[20]  Panos M. Pardalos,et al.  Biclustering in data mining , 2008, Comput. Oper. Res..