Image Restoration in Portable Devices: Algorithms and Optimization

Image and video data acquired by portable devices such as mobile phones are degraded by noise and blur due to the small size of optical sensors in these devices. A wide range of image restoration methods exists, yet feasibility of these methods in portable platforms is not guaranteed due to limited hardware resources on such platforms. The paper addresses this problem by focusing on denoising algorithms. We have chosen two representatives of denoising methods with state-of-the-art performance, and propose different parallel implementations and algorithmic simplifications suitable for mobile phones. In addition, an extension to resolution enhancement is presented including both visual and quantitative comparisons. Analysis of the algorithms is carried out with respect to the computation time, power consumption and output image quality.

[1]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[2]  Aleksandra Pizurica,et al.  A GPU-Accelerated Real-Time NLMeans Algorithm for Denoising Color Video Sequences , 2010, ACIVS.

[3]  Jan Flusser,et al.  A Unified Approach to Superresolution and Multichannel Blind Deconvolution , 2007, IEEE Transactions on Image Processing.

[4]  Adrián Márques,et al.  Implementation of Non Local Means Filter in GPUs , 2013, CIARP.

[5]  Jan Flusser,et al.  Super-Resolution and Blind Deconvolution For Rational Factors With an Application to Color Images , 2009, Comput. J..

[6]  Jani Boutellier,et al.  Evaluation of real-time LBP computing in multiple architectures , 2014, Journal of Real-Time Image Processing.

[7]  Jari Hannuksela,et al.  Performance evaluation of image noise reduction computing on a mobile platform , 2015, 2015 International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (SAMOS).

[8]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[9]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[11]  Alex Ramírez,et al.  Energy Efficient HPC on Embedded SoCs: Optimization Techniques for Mali GPU , 2014, 2014 IEEE 28th International Parallel and Distributed Processing Symposium.

[12]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[13]  Patrick Bouthemy,et al.  Optical flow modeling and computation: A survey , 2015, Comput. Vis. Image Underst..

[14]  Salvatore Cuomo,et al.  3D Non-Local Means denoising via multi-GPU , 2013, 2013 Federated Conference on Computer Science and Information Systems.

[15]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[16]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[17]  Peyman Milanfar,et al.  Is Denoising Dead? , 2010, IEEE Transactions on Image Processing.

[18]  Suren Jayasuriya,et al.  Reconfiguring the Imaging Pipeline for Computer Vision , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Jean-Michel Morel,et al.  A Nonlocal Bayesian Image Denoising Algorithm , 2013, SIAM J. Imaging Sci..

[20]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).