A Comparison of Fusion Algorithms and Metrics and Their Agreement with Visual Perception Laboratory Detection Probability Values

Abstract : The Visual Perception Laboratory (VPL) of TARDEC has developed a camera system that provides panoramic image fusion that can be integrated into various types of vehicles. The camera system is a combination of infrared (IR) and visual cameras that generates a panoramic image and provides situational awareness to the crew of an armored vehicle prior to egress as well as hemispherical awareness during patrol activity. Image fusion is being used more and more by the US Army for target recognition and situational awareness. Several algorithms for fusing imagery are tested by the authors and the quality of the fused images are assessed using metrics from the literature and compared to experimental values obtained in the Visual Perception Lab. This work supports a joint TARDEC/NVESD STO on Situational Awareness.