Our research is to develop a signal processing process for separating musical audio signals into streams of individual sound sources. In this paper, we present a method that uses NMF method and some musical cues for musical source separation. The conventional separation method based on NMF method classify the separated note events into each stream „manually‟, so the conventional methods are difficult to use in the real engineering. However, our method performs „automatically‟ the classification process different from the conventional methods. The proposed process consists of the separation step and the reconstruction step. In the separation step, the audio stream is divided into “musical events,” groups of the notes which have same frequency structures. The separation method is based on the Wang‟s method, which used Non-negative Matrix Factorization (NMF) method. In the reconstruction step, the divided note events are automatically grouped into streams of the individual sound sources using the musical cues. The proposed musical cues consist of the timbre features, the temporal features, and the pitch components. The proposed separation system is evaluated with some musical signals which contain the multi musical sources. The evaluation shows the proposed method can perform „automatically‟ the separation using the proposed cues and have the same performance as manual classification.
[1]
E. Oja,et al.
Independent Component Analysis
,
2001
.
[2]
H. Sebastian Seung,et al.
Algorithms for Non-negative Matrix Factorization
,
2000,
NIPS.
[3]
Tuomas Virtanen,et al.
Separation of drums from polyphonic music using non-negative matrix factorization and support vector machine
,
2005,
2005 13th European Signal Processing Conference.
[4]
Ronaldus Maria Aarts,et al.
Audio Bandwidth Extension: Application of Psychoacoustics, Signal Processing and Loudspeaker Design
,
2004
.
[5]
Christian Uhle,et al.
EXTRACTION OF DRUM TRACKS FROM POLYPHONIC MUSIC USING INDEPENDENT SUBSPACE ANALYSIS
,
2003
.
[6]
Pierre Comon,et al.
Independent component analysis, A new concept?
,
1994,
Signal Process..
[7]
Vladimir Soutchiline.
On Audio Noise Likeness-Index Evaluation
,
1995
.
[8]
Daniel Patrick Whittlesey Ellis,et al.
Prediction-driven computational auditory scene analysis
,
1996
.
[9]
Queen Mary.
MUSICAL AUDIO STREAM SEPARATION BY NON-NEGATIVE MATRIX FACTORIZATION
,
2005
.
[10]
Daniel P. W. Ellis.
Computational Auditory Scene Analysis
,
2005
.
[11]
H Hermansky,et al.
Perceptual linear predictive (PLP) analysis of speech.
,
1990,
The Journal of the Acoustical Society of America.