k-Reciprocal Harmonious Attention Network for Video-Based Person Re-Identification

Video-based person re-identification aims to retrieve video sequences of the same person in the multi-camera system. In this paper, we propose a <inline-formula> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula>-reciprocal harmonious attention network (KHAN) to jointly learn discriminative spatiotemporal features and the similarity metrics. In KHAN, the harmonious attention module adaptively calibrates response at each spatial position and each channel by explicitly inspecting position-wise and channel-wise interactions over feature maps. Besides, the <inline-formula> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula>-reciprocal attention module attends key features from all frame-level features with a discriminative feature selection algorithm; thus, useful temporal information within contextualized key features can be assimilated to produce more robust clip-level representation. Compared with commonly used local-context based approaches, the proposed KHAN captures long dependency of different spatial regions and visual patterns while incorporating informative context at each time-step in a non-parametric manner. The extensive experiments on three public benchmark datasets show that the performance of our proposed approach outperforms the state-of-the-art methods.