In last few years, guided image fusion algorithms become more and more popular. However, the current algorithms cannot solve the halo artifacts. We propose an image fusion algorithm based on fast weighted guided filter. Firstly, the source images are separated into a series of high and low frequency components. Secondly, three visual features of the source image are extracted to construct a decision graph model. Thirdly, a fast weighted guided filter is raised to optimize the result obtained in the previous step and reduce the time complexity by considering the correlation among neighboring pixels. Finally, the image obtained in the previous step is combined with the weight map to realize the image fusion. The proposed algorithm is applied to multi-focus, visible-infrared and multi-modal image respectively and the final results show that the algorithm effectively solves the halo artifacts of the merged images with higher efficiency, and is better than the traditional method considering subjective visual consequent and objective evaluation.