DOA estimation of mixed signals under unknown mutual coupling

An efficient method to deal with direction of arrival (DOA) estimation of mixed signals under unknown mutual coupling is proposed. Several groups of signals are included in the mixed signals, where signals in the same group are coherent while in different groups are independent with each other. Our proposed method realizes high utilization ratio of array sensors based on the independence of different groups. By using subspace smoothing and multiple signal classification (MUSIC) algorithm, DOA and mutual coupling coefficients are estimated sequentially, where some transformation of steering vector is applied to reduce computational amount. Simulations verify the effectiveness of proposed method.