FPGA based multi-shell filter for hot pixel removal within colour filter array demosaicing

Modern cameras have an image sensor with millions of pixels, among which some of them are inevitably defective (known as hot pixels). Moreover, the number of hot pixels will increase with ageing. colour filter array (CFA) demosaicing will result in colour artifacts caused by these hot pixels. Such artifacts are virtually impossible to remove after demosaicing. In this paper, we propose two effective filter structures for removing low and high density hot pixels within CFA demosaicing for efficient implementation on FGPA for real-time processing. It has been shown that our proposed filter structures are able to remove hot pixels effectively with minimal colour artifacts while preserving image details.

[1]  Touraj Tajbakhsh.  Efficient defect pixel cluster detection and correction for Bayer CFA image sequences , 2011, Electronic Imaging.

[2]  Sharmil Randhawa,et al.  Adaptive order-statistics multi-shell filtering for bad pixel correction within CFA demosaicking , 2009, TENCON 2009 - 2009 IEEE Region 10 Conference.

[3]  Donald G. Bailey,et al.  Design for Embedded Image Processing on FPGAs: Bailey/Design for Embedded Image Processing on FPGAs , 2011 .

[4]  Albert J. P. Theuwissen,et al.  Adaptive pixel defect correction , 2003, IS&T/SPIE Electronic Imaging.

[5]  A. Ramsingh,et al.  Adaptive median based multi-shell-order-statistics filters for the removal of impulsive noise , 1994, Proceedings of ICSIPNN '94. International Conference on Speech, Image Processing and Neural Networks.

[6]  Jim S. Jimmy Li.  Median-based feature selective filtering , 1990, Other Conferences.

[7]  Chien-Wei Chen,et al.  Low complexity photo sensor dead pixel detection algorithm , 2012, 2012 IEEE Asia Pacific Conference on Circuits and Systems.

[8]  Donald G. Bailey,et al.  Design for Embedded Image Processing on FPGAs , 2011 .

[9]  Jim S. Jimmy Li.  A class of multi-shell min/max median filters , 1989, IEEE International Symposium on Circuits and Systems,.

[10]  J. S. Jimmy Li,et al.  Advanced Bayer demosaicing on FPGAs , 2015, 2015 International Conference on Field Programmable Technology (FPT).

[11]  J. S. Jimmy Li,et al.  Statistical analysis of the median based multi-shell order-statistics filters , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Donald G. Bailey.  Image Border Management for FPGA Based Filters , 2011, 2011 Sixth IEEE International Symposium on Electronic Design, Test and Application.

[13]  J. S. Jimmy Li,et al.  Hot pixel removal within colour filter array demosaicking using modified bilateral filters , 2013, 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013).

[14]  J. S. Jimmy Li,et al.  The relationship of the multi-shell to multistage and standard median filters , 1995, IEEE Trans. Image Process..