Photometric alignment for surround view camera system

Surround view camera system is an emerging automotive ADAS (Advanced Driver Assistance System) technology that helps drivers park safer by allowing him/her to see the complete 360-degree surrounding of the vehicle. Such a system normally consists of four to six wide-angle cameras mounted around the vehicle, each facing one direction. From these camera inputs, a composite bird-eye view of the vehicle is synthesized and shown to the driver in real time during parking. One common problem in existing solutions is that the composite view has noticeable boundaries between adjacent views due to different lighting conditions faced by different cameras, as well as different auto-exposure (AE) and auto white balance (AWB) each camera has. This paper describes a computationally efficient method to correct for the photometric misalignment, i.e., brightness and color mismatch, across different cameras. With the proposed methods and proper calibration of the cameras, we achieved a seamlessly stitched 360 degree surround view.

[1]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[2]  Edmund Y. Lam,et al.  Digital photograph stitching with optimized matching of gradient and curvature , 2006, Electronic Imaging.

[3]  Ming-Shi Wang,et al.  A Vision Based Top-View Transformation Model for a Vehicle Parking Assistant , 2012, Sensors.

[4]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[5]  Richard L. Burden,et al.  Numerical analysis: 4th ed , 1988 .

[6]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Frank Nielsen,et al.  Surround video: a multihead camera approach , 2005, The Visual Computer.

[8]  Yong-Sheng Chen,et al.  Bird's-Eye View Vision System for Vehicle Surrounding Monitoring , 2008, RobVis.

[9]  Taesung Park,et al.  Photometric and geometric rectification for stereoscopic images , 2012, Electronic Imaging.

[10]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[11]  J. W. Chang,et al.  Image-Based Parking Guiding Using Ackermann Steering Geometry , 2013 .