ADVANCES IN IMAGE PRE-PROCESSING TO IMPROVE AUTOMATED 3D RECONSTRUCTION

Abstract. Tools and algorithms for automated image processing and 3D reconstruction purposes have become more and more available, giving the possibility to process any dataset of unoriented and markerless images. Typically, dense 3D point clouds (or texture 3D polygonal models) are produced at reasonable processing time. In this paper, we evaluate how the radiometric pre-processing of image datasets (particularly in RAW format) can help in improving the performances of state-of-the-art automated image processing tools. Beside a review of common pre-processing methods, an efficient pipeline based on color enhancement, image denoising, RGB to Gray conversion and image content enrichment is presented. The performed tests, partly reported for sake of space, demonstrate how an effective image pre-processing, which considers the entire dataset in analysis, can improve the automated orientation procedure and dense 3D point cloud reconstruction, even in case of poor texture scenarios.

[1]  Suyash P. Awate,et al.  Unsupervised, information-theoretic, adaptive image filtering for image restoration , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  E. Kolaczyk.  WAVELET SHRINKAGE ESTIMATION OF CERTAIN POISSON INTENSITY SIGNALS USING CORRECTED THRESHOLDS , 1999 .

[3]  Brian A. Wandell,et al.  Water into wine: converting scanner RGB to tristimulus XYZ , 1993, Electronic Imaging.

[4]  Karol Myszkowski,et al.  Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video , 2008, Comput. Graph. Forum.

[5]  Richard G. Baraniuk,et al.  Wavelet domain filtering for photon imaging systems , 1997, Optics & Photonics.

[6]  Alessandro Foi,et al.  Optimal Inversion of the Anscombe Transformation in Low-Count Poisson Image Denoising , 2011, IEEE Transactions on Image Processing.

[7]  Jean-Michel Morel,et al.  The Noise Clinic: a Blind Image Denoising Algorithm , 2015, Image Process. Line.

[8]  Paolo Cignoni,et al.  Machine Vision and Applications Manuscript No , 2022 .

[9]  Emmanuel P. Baltsavias,et al.  Multiphoto geometrically constrained matching , 1991 .

[10]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[11]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, SIGGRAPH 2005.

[12]  Alessandro Foi,et al.  Noise estimation and removal in MR imaging: The variance-stabilization approach , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[14]  Fabio Remondino,et al.  Orientation and 3D modelling from markerless terrestrial images: combining accuracy with automation , 2010 .

[15]  Armin Gruen,et al.  Turning Images into 3-D Models ( Developments and performance analysis of image matching for detailed surface reconstruction of heritage objects ) , 2008 .

[16]  Jean-Michel Morel,et al.  Secrets of image denoising cuisine* , 2012, Acta Numerica.

[17]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[18]  Jeff Schewe,et al.  Real World Camera Raw with Adobe Photoshop CS5 , 2005 .

[19]  S. Robson,et al.  Modelling the appearance of heritage metallic surfaces , 2014 .

[20]  Jingge Wu.  A Color-Rendition Chart , 2017 .

[21]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[22]  T. Ohdake,et al.  3D MODELING OF HIGH RELIEF SCULPTURE USING IMAGE BASED INTEGRATED MEASUREMENT SYSTEM , 2005 .

[23]  Leonid P. Yaroslavsky,et al.  Local adaptive image restoration and enhancement with the use of DFT and DCT in a running window , 1996, Optics & Photonics.

[24]  Cewu Lu,et al.  Contrast preserving decolorization , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[25]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[26]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[27]  D. Pascale.  RGB coordinates of the Macbeth ColorChecker , 2006 .

[28]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[29]  E. Baltsavias,et al.  Cloud mapping from the ground: use of photogrammetric methods , 2002 .

[30]  M. Ronnier Luo,et al.  Testing Color-Difference Formulae on Complex Images Using a CRT Monitor , 2000, Color Imaging Conference.

[31]  Seungyong Lee,et al.  Robust color-to-gray via nonlinear global mapping , 2009, ACM Trans. Graph..

[32]  Jean-Michel Morel,et al.  Nonparametric noise estimation method for raw images. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[33]  Cosmin Ancuti,et al.  Decolorizing images for robust matching , 2010, 2010 IEEE International Conference on Image Processing.

[34]  Cewu Lu,et al.  Contrast Preserving Decolorization with Perception-Based Quality Metrics , 2014, International Journal of Computer Vision.

[35]  Xiaobin Xu,et al.  Decolorization: is rgb2gray() out? , 2013, SIGGRAPH ASIA Technical Briefs.

[36]  Livio De Luca,et al.  Automated Image-Based Procedures for Accurate Artifacts 3D Modeling and Orthoimage Generation , 2011 .

[37]  Karen O. Egiazarian,et al.  Color Image Denoising via Sparse 3D Collaborative Filtering with Grouping Constraint in Luminance-Chrominance Space , 2007, 2007 IEEE International Conference on Image Processing.

[38]  Fabrizio Ivan Apollonio,et al.  Evaluation of feature-based methods for automated network orientation , 2014 .

[39]  Thomas P. Kersten,et al.  Low-Cost and Open-Source Solutions for Automated Image Orientation - A Critical Overview , 2012, EuroMed.

[40]  Garrett M. Johnson,et al.  Color Imaging: Fundamentals and Applications , 2008 .

[41]  Neil A. Dodgson,et al.  Decolorize: Fast, contrast enhancing, color to grayscale conversion , 2007, Pattern Recognit..