A parallel camera image signal processor for SIMD architecture

An image signal processor (ISP) for a camera image sensor consists of many complicated functions; in this paper, a full chain of the ISP functions for smart devices is presented. Each function in the proposed ISP full chain is designed to handle high-quality images. Every function in the chain is fully converted to a fixed-point arithmetic, and a special function is not used for easy porting to a Samsung Reconfigurable Processor (SRP). Several parallelizing optimization techniques are applied to the proposed ISP full chain for real-time operation on a given 600-MHz reconfigurable processor. To verify the performance of the proposed ISP full chain, a series of tests was performed, and all of the measured values satisfy the quality and performance requirements.

[1]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Mark D. Fairchild,et al.  Color Appearance Models , 1997, Computer Vision, A Reference Guide.

[3]  Guillermo Sapiro,et al.  Color and Illuminant Voting , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  O. Ghita,et al.  Adaptive noise removal approach for restoration of digital images corrupted by multimodal noise , 2012 .

[5]  Jörg Weule,et al.  Non-Linear Gaussian Filters Performing Edge Preserving Diffusion , 1995, DAGM-Symposium.

[6]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Glen Pringle,et al.  Color correction for an image sequence , 1995, IEEE Computer Graphics and Applications.

[8]  Soojung Ryu,et al.  Mobile GPU shader processor based on non-blocking Coarse Grained Reconfigurable Arrays architecture , 2013, 2013 International Conference on Field-Programmable Technology (FPT).

[9]  Lieven Eeckhout,et al.  Cole: compiler optimization level exploration , 2008, CGO '08.

[10]  Fatih Porikli,et al.  Constant time O(1) bilateral filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Frédo Durand,et al.  Bilateral Filtering: Theory and Applications , 2009, Found. Trends Comput. Graph. Vis..

[12]  Soojung Ryu,et al.  Design space exploration and implementation of a high performance and low area Coarse Grained Reconfigurable Processor , 2012, 2012 International Conference on Field-Programmable Technology.

[13]  Jongwoo Bae,et al.  Color transient improvement with transient detection and variable length nonlinear filtering , 2008, IEEE Transactions on Consumer Electronics.

[14]  Youngsam Shin,et al.  Real-time ray tracing on coarse-grained reconfigurable processor , 2013, 2013 International Conference on Field-Programmable Technology (FPT).

[15]  Etienne E. Kerre,et al.  Fuzzy Random Impulse Noise Removal From Color Image Sequences , 2011, IEEE Transactions on Image Processing.

[16]  Jing Wang,et al.  Robust automatic white balance algorithm using gray color points in images , 2006, IEEE Transactions on Consumer Electronics.

[17]  Seunghun Jin,et al.  Low-power reconfigurable audio processor for mobile devices , 2014, 2014 IEEE International Conference on Consumer Electronics (ICCE).

[18]  Joonki Paik,et al.  Adaptive contrast enhancement using gain-controllable clipped histogram equalization , 2008, IEEE Transactions on Consumer Electronics.

[19]  Dacheng Xu,et al.  Study of MTF measurement technique based on special object image analyzing , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[20]  Giancarlo Calvagno,et al.  Color image demosaicking: An overview , 2011, Signal Process. Image Commun..

[21]  Ching-Chih Weng,et al.  A novel automatic white balance method for digital still cameras , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[22]  N. Kehtarnavaz,et al.  Development and Real-Time Implementation of Auto White Balancing Scoring Algorithm , 2002, Real Time Imaging.

[23]  N. Seshan.  High VelociTI processing [Texas Instruments VLIW DSP architecture] , 1998 .

[24]  Kyu-Ik Sohng,et al.  Optimal Piece Linear Segments of Gamma Correction for CMOS Image Sensors , 2005, IEICE Trans. Electron..

[25]  Radu Ciprian Bilcu,et al.  Multiframe Auto White Balance , 2011, IEEE Signal Processing Letters.

[26]  Silong Peng,et al.  Video luminance transient improvement using difference-of-Gaussian , 2009, 2009 15th Asia-Pacific Conference on Communications.

[27]  Heung-Kook Choi,et al.  Image contrast enhancement using bi-histogram equalization with neighborhood metrics , 2010, IEEE Transactions on Consumer Electronics.

[28]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[29]  J. Kim,et al.  Case Study: Verification Framework of Samsung Reconfigurable Processor , 2012, 2012 13th International Workshop on Microprocessor Test and Verification (MTV).

[30]  R.W. Schafer,et al.  Demosaicking: color filter array interpolation , 2005, IEEE Signal Processing Magazine.

[31]  Seong-Won Lee,et al.  Implementation of an image signal processor for reconfigurable processors , 2014, 2014 IEEE International Conference on Consumer Electronics (ICCE).

[32]  Takeshi Takaki,et al.  500-fps face tracking system , 2012, Journal of Real-Time Image Processing.

[33]  Steve Furber.  ARM System-on-Chip Architecture , 2000 .

[34]  Pankaj Shailendra Gode,et al.  Function inlining and loop unrolling for loop acceleration in reconfigurable processors , 2012, CASES '12.

[35]  Mikko H. Lipasti,et al.  Modern Processor Design: Fundamentals of Superscalar Processors , 2002 .

[36]  Thomas W. Parks,et al.  Adaptive homogeneity-directed demosaicing algorithm , 2005, IEEE Transactions on Image Processing.