CI-SNF: Exploiting contextual information to improve SNF based information retrieval

Abstract Similarity networks contain important topological features and patterns critical to understanding interactions among samples in a large dataset. To create a comprehensive view of the interactions within a dataset, the Similarity Network Fusion (SNF) technique has been proposed to fuse the similarity networks based on different data types into one similarity network that represents the full spectrum of underlying data. In this paper, a modified version of SNF, which is named as Contextual Information based SNF (CI-SNF), is proposed. In CI-SNF, first, modified Jaccard distance is performed on the SNF fused similarity to utilize the contextual information contained in the fused similarity network. Second, the local consistency of samples from the same category is enhanced by speculating that the samples which are located high in the Jaccard distance based ranking list of a specific query are from the same category as the query. Third, the inverted index technique is introduced to utilize the sparsity property of the locally consistent similarity network to enhance the computational efficiency. To verify the effectiveness and efficiency of CI-SNF model, it is applied in four different tasks, Cover Song Identification (CSI), image classification, cancer subtype identification, and drug taxonomy, respectively. Extensive experiments on thirteen challenging datasets demonstrate that CI-SNF scheme outperforms state-of-the-art similarity fusion algorithms including SNF in all four tasks. It is also verified that utilizing the contextual information contained in the SNF-based similarity network helps to enhance the performance of the SNF-based scheme, further.

[1]  Christopher J. Tralie Early MFCC and HPCP Fusion for Robust Cover Song Identification , 2017, ISMIR.

[2]  Jiuyong Li,et al.  Identifying Cancer Subtypes from miRNA-TF-mRNA Regulatory Networks and Expression Data , 2016, PloS one.

[3]  Steven J. M. Jones,et al.  Comprehensive molecular characterization of human colon and rectal cancer , 2012, Nature.

[4]  Marc Van Droogenbroeck,et al.  Enhancing Cover Song Identification with Hierarchical Rank Aggregation , 2016, ISMIR.

[5]  Ming Yang,et al.  Query Specific Rank Fusion for Image Retrieval , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Wei Li,et al.  Fusing similarity functions for cover song identification , 2017, Multimedia Tools and Applications.

[7]  Emilia Gómez,et al.  Melody, bass line, and harmony representations for music version identification , 2012, WWW.

[8]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[9]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Rongrong Ji,et al.  Weakly Supervised Multi-Graph Learning for Robust Image Reranking , 2014, IEEE Transactions on Multimedia.

[11]  Claudio Moraga,et al.  Leveraging similarities and structure for dense representations combination in image retrieval , 2016, J. Vis. Commun. Image Represent..

[12]  Steven J. M. Jones,et al.  Comprehensive genomic characterization of squamous cell lung cancers , 2012, Nature.

[13]  Simon Dixon,et al.  Combining Features for Cover Song Identification , 2015, ISMIR.

[14]  Rama Chellappa,et al.  Joint Sparse Representation and Robust Feature-Level Fusion for Multi-Cue Visual Tracking , 2015, IEEE Transactions on Image Processing.

[15]  Larry S. Davis,et al.  Re-ranking by Multi-feature Fusion with Diffusion for Image Retrieval , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[16]  P. Bork,et al.  Drug discovery in the age of systems biology: the rise of computational approaches for data integration. , 2012, Current opinion in biotechnology.

[17]  Ning Chen,et al.  Similarity fusion scheme for cover song identification , 2016 .

[18]  Bo Wang,et al.  Dynamic Label Propagation for Semi-supervised Multi-class Multi-label Classification , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Shiliang Zhang,et al.  Semantic-Aware Co-Indexing for Image Retrieval. , 2015, IEEE transactions on pattern analysis and machine intelligence.

[20]  Riccardo Leonardi,et al.  A heuristic for distance fusion in cover song identification , 2013, 2013 14th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS).

[21]  Mathieu Lagrange,et al.  Multimodal similarity between musical streams for cover version detection , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  Bo Wang,et al.  Visualization and analysis of single-cell RNA-seq data by kernel-based similarity learning , 2016, Nature Methods.

[23]  Zhuowen Tu,et al.  Similarity network fusion for aggregating data types on a genomic scale , 2014, Nature Methods.

[24]  R. Tagliaferri,et al.  Discovery of drug mode of action and drug repositioning from transcriptional responses , 2010, Proceedings of the National Academy of Sciences.

[25]  J. Stephen Downie,et al.  Cochlear pitch class profile for cover song identification , 2015 .

[26]  R. Shoemaker The NCI60 human tumour cell line anticancer drug screen , 2006, Nature Reviews Cancer.

[27]  R. Andrzejak,et al.  Cross recurrence quantification for cover song identification , 2009 .

[28]  Stefan Günther,et al.  SuperPred: drug classification and target prediction , 2008, Nucleic Acids Res..

[29]  Peer Bork,et al.  Drug-Induced Regulation of Target Expression , 2010, PLoS Comput. Biol..

[30]  Daniel P. W. Ellis,et al.  Cover song detection: From high scores to general classification , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[31]  Steven J. M. Jones,et al.  Comprehensive molecular portraits of human breast tumors , 2012, Nature.

[32]  Diego di Bernardo,et al.  Identifying Network of Drug Mode of Action by Gene Expression Profiling , 2009, J. Comput. Biol..

[33]  Song Bai,et al.  Sparse Contextual Activation for Efficient Visual Re-Ranking , 2016, IEEE Transactions on Image Processing.

[34]  Fan Zhao,et al.  Dynamic graph fusion label propagation for semi-supervised multi-modality classification , 2017, Pattern Recognit..

[35]  Yu Zhou,et al.  Similarity Fusion for Visual Tracking , 2015, International Journal of Computer Vision.

[36]  Andrew Zisserman,et al.  Automated Flower Classification over a Large Number of Classes , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[37]  Bo Wang,et al.  Co-Transduction for Shape Retrieval , 2010, IEEE Transactions on Image Processing.

[38]  Markus Schedl,et al.  Local and global scaling reduce hubs in space , 2012, J. Mach. Learn. Res..

[39]  Michael J. Keiser,et al.  Predicting new molecular targets for known drugs , 2009, Nature.

[40]  Bo Wang,et al.  Unsupervised metric fusion by cross diffusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Jian Sun,et al.  Collaborative Index Embedding for Image Retrieval , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Daniel P. W. Ellis,et al.  Identifying "Cover Songs" with Beat-Synchronous Chroma Features , 2006 .

[43]  Emilia Gómez,et al.  Audio Cover Song Identification and Similarity: Background, Approaches, Evaluation, and Beyond , 2010, Advances in Music Information Retrieval.

[44]  Xavier Serra,et al.  Chroma Binary Similarity and Local Alignment Applied to Cover Song Identification , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[45]  Ning Chen,et al.  Two-layer similarity fusion model for cover song identification , 2017, EURASIP J. Audio Speech Music. Process..

[46]  Ning Chen,et al.  Modified Perceptual Linear Prediction Liftered Cepstrum (MPLPLC) Model for Pop Cover Song Recognition , 2015, ISMIR.

[47]  Paul Bendich,et al.  Cover Song Identification with Timbral Shape Sequences , 2015, ISMIR.

[48]  Laleh Soltan Ghoraie,et al.  Integrative Cancer Pharmacogenomics to Infer Large-Scale Drug Taxonomy. , 2017, Cancer research.