A 6-DOFs event-based camera relocalization system by CNN-LSTM and image denoising

Abstract At present, in the research of simultaneous localization and mapping systems, many traditional relocalization methods have been replaced by camera relocalization techniques based on convolutional neural network (CNN) and long and short-term memory (LSTM). However, in a system using an event dataset to train the neural network, the complex scenes are chaotic, and the noise of the event images is excessive. Both issues make the model unable to return to the six-degrees of freedom (6-DOFs) pose well. This paper proposes a 6-DOFs pose camera relocalization method based on the CNN image denoising model and CNN-LSTM. Firstly, the CNN image denoising model is used to solve the problem of excessive noise points in complex scenes. Then, a network framework combining CNN and LSTM trains the event camera relocalization model to obtain better 6-DOFs pose accuracy. Finally, the study performs experimental simulations by using complex scene datasets without and with denoising images. Experimental results show that the proposed method of camera relocalization has many advantages. It enhances the robustness of the model in the training process, reduces the mutation situation, and the trained model has a smaller error and faster speed when predicting the pose, thus improving the accuracy and real-time of the camera relocalization model.