Image Deblurring using Multi-Scale Dilated Convolutions in a LSTM-based Neural Network

This work describes the development of a compact neural network for the blind deconvolution and restoration of a blurred image. A scale-based, convolutional, long-short term memory (LSTM) network is developed for image deblurring. In this network, multi-scale information is obtained through the use of dilated convolutions and this is shared between scales using recurrent connections. The proposed network is designed to be of low-parameter count and to deblur an image without the use of prior information. We show the effectiveness of this approach through evaluation with industry standard datasets (GOPRO [2] and Kohler [10]), and we compare our results with those of two other state-of-the-art blind deblurring networks. Our results show that a comparable sharp image can be recovered more efficiently with a significant reduction in the total number of network parameters.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[3]  Tae Hyun Kim,et al.  Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[5]  Bernhard Schölkopf,et al.  Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database , 2012, ECCV.

[6]  Long-Wen Chang,et al.  Blind Motion Deblurring via Inceptionresdensenet by Using GAN Model , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[8]  Subhasis Chaudhuri,et al.  Blind Image Deconvolution , 2014, Springer International Publishing.

[9]  Yi Wang,et al.  Scale-Recurrent Network for Deep Image Deblurring , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Wuzhen Shi,et al.  Single image super-resolution with dilated convolution based multi-scale information learning inception module , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.