Audio retrieval by segment-based manifold-ranking

This paper proposes a new approach for the query-byexample audio retrieval, named as segment-based manifoldranking algorithm. Our approach adopts the audio segment, instead of the whole audio, as the basic unit for the manifold-ranking process. We formulate the query-byexample audio retrieval as a manifold-ranking problem in two stages: initial ranking and re-ranking. In the initial ranking stage, we use the existing distance functions to rank all audios according to their similarity values with the query. In the re-ranking stage, each audio is divided into some segments by the detected change points, and then the segment-based manifold-ranking algorithm is employed to re-rank the initial retrieved audios. Experimental results show the proposed approach is effective to improve the ranking capability of the existing distance functions, and the audio segment is a more appropriate unit for the manifoldranking algorithm than the whole audio.

[1]  Chong-Wah Ngo,et al.  Audio similarity measure by graph modeling and matching , 2006, MM '06.

[2]  Lie Lu,et al.  Content analysis for audio classification and segmentation , 2002, IEEE Trans. Speech Audio Process..

[3]  Haizhou Li,et al.  Music structure based vector space retrieval , 2006, SIGIR.

[4]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[5]  Bernhard Schölkopf,et al.  Ranking on Data Manifolds , 2003, NIPS.

[6]  Mauro Cettolo,et al.  Efficient audio segmentation algorithms based on the BIC , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[7]  Yannis Stylianou,et al.  Musical Genre Classification Using Nonnegative Matrix Factorization-Based Features , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[8]  Lawrence K. Saul,et al.  Nonnegative matrix factorization for real time musical analysis and sight-reading evaluation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Xiaojun Wan,et al.  Content Based Image Retrieval Using Manifold-Ranking of Blocks , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[10]  Qian Huang,et al.  Content-based indexing and retrieval-by-example in audio , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[11]  Jingrui He,et al.  Manifold-ranking based image retrieval , 2004, MULTIMEDIA '04.