We present a fuzzy evidential reasoning algorithm in light of the Dempster-Shafer evidence theory and the K-nearest neighbor algorithm for pattern classification. Given an input pattern to be classified, each of its K nearest neighbors is viewed as an evidence source, in terms of a fuzzy evidence structure. The distance between the input pattern and each of its K nearest neighbors is used for mass determination while the contextual information of the nearest neighbor in the training sample space is formulated by a fuzzy set in determining a fuzzy focal element. Therefore, pooling evidence provided by neighbors is realized by a fuzzy evidential reasoning, where feature selection is further considered through ranking and adaptive combination of neighbors. A fast implementation scheme of the fuzzy evidential reasoning is also developed. Experimental results of classifying multichannel remote sensing images have shown that the proposed approach outperforms the K-nearest neighbor (K-NN) algorithm [T.M. Cover et al. (1967)], the fuzzy K-nearest neighbor (F-KNN) algorithm [J.M. Keller et al. (1985)], the evidence-theoretic K-nearest neighbor (E-KNN) algorithm [T. Denoex (1995)], and the fuzzy extended version of E-KNN (FE-KNN) [L.M. Zouhal et al. (1997)], in terms of the classification accuracy and insensitivity to the number K of nearest neighbors.
[1]
Peter E. Hart,et al.
Nearest neighbor pattern classification
,
1967,
IEEE Trans. Inf. Theory.
[2]
James M. Keller,et al.
A fuzzy K-nearest neighbor algorithm
,
1985,
IEEE Transactions on Systems, Man, and Cybernetics.
[3]
Thierry Denoeux,et al.
A k-nearest neighbor classification rule based on Dempster-Shafer theory
,
1995,
IEEE Trans. Syst. Man Cybern..
[4]
Thierry Denoeux,et al.
Generalizing the Evidence-Theoretic k-NN rule to Fuzzy Pattern Recognition
,
1997
.
[5]
Lorenzo Bruzzone,et al.
Combination of neural and statistical algorithms for supervised classification of remote-sensing image
,
2000,
Pattern Recognit. Lett..
[6]
Otman A. Basir,et al.
A scheme for constructing evidence structures in Dempster-Shafer evidence theory for data fusion
,
2003,
Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).