Real-time image recovery using temporal image fusion

In computer vision systems an unpredictable image corruption can have significant impact on its usability. Image recovery methods for partial image damage, in particular in moving scenarios, can be crucial for recovering corrupted images. In these situations, image fusion techniques can be successfully applied to congregate information taken at different instants and from different points-of-view to recover damaged parts. In this article we propose a technique for temporal and spatial image fusion, based on fuzzy classification, which allows partial image recovery upon unexpected defects without user intervention. The method uses image alignment techniques and duplicated information from previous images to create fuzzy confidence maps. These maps are then used to detect damaged pixels and recover them using information from previous frames.

[1]  Rita Almeida Ribeiro,et al.  Optimized and flexible multi-criteria decision making for hazard avoidance , 2010 .

[2]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[3]  Tong Heng Lee,et al.  A Robust Real-Time Embedded Vision System on an Unmanned Rotorcraft for Ground Target Following , 2012, IEEE Transactions on Industrial Electronics.

[4]  Abd El Rahman Shabayek,et al.  Vision Based UAV Attitude Estimation: Progress and Insights , 2012, J. Intell. Robotic Syst..

[5]  Maria Rita Sarmento de Almeida Ribeiro Real-Time Planetary Landing Site Selection — A Non-Exhaustive Approach , 2012 .

[6]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[7]  Rita Almeida Ribeiro,et al.  Benefits of Full-Reinforcement Operators for Spacecraft Target Landing , 2010, Preferences and Decisions.

[8]  T. Ross Fuzzy Logic with Engineering Applications , 1994 .

[9]  Timothy J. Ross,et al.  Fuzzy Logic with Engineering Applications: Ross/Fuzzy Logic with Engineering Applications , 2010 .

[10]  Dong-Il Cho,et al.  A new localization method for mobile robot by data fusion of vision sensor data and motion sensor data , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[11]  Jyh-Horng Jeng,et al.  Region-Based Image Fusion with Artificial Neural Network , 2009 .

[12]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[13]  Liming Xu,et al.  Autonomous Agricultural Robot and its Row Guidance , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[14]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..