Three-Dimensional Density Estimation of Flame Captured From Multiple Cameras

Optical combustion measurement and analysis systems using multiple sensors have received considerable attention. In particular, the image-based flame 3D reconstruction approaches using computerized tomography have been widely applied for the flame 3D reconstruction from a set of views by constructing the optimized linear combinations of the 3D scene and projected images. Previous techniques were easily computed but were weak against noise and blurring due to the underlying least square-based loss function. This paper presents a 3D density flame reconstruction method, captured from the sparse multi-view images, as a constrained optimization problem between the flame and its projected images. For effective estimation of the flame with a complicated structure in an arbitrary viewpoint, we extract the 3D candidate region of the flame and, then, estimate the density field using the compressive sensing. The objective function is a linear combination of the photo consistency cost and sparsity regularization terms, which avoids blurring in the reconstruction. The proposed approach is a powerful matrix factorization method with each voxel represented as a linear combination of a small number of basis vectors. The approach also effectively simplifies the reconstruction process and provides the whole 3D density field in one step. The experimental results verify that the proposed 3D density estimation performs favorably from the few flame images.

[1]  Subhash Challa,et al.  Nonnegative-Least-Square Classifier for Face Recognition , 2009, ISNN.

[2]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[3]  Suk Ho Chung,et al.  Several applications of laser diagnostics for visualization of combustion phenomena , 2003, J. Vis..

[4]  Yong Yan,et al.  A digital imaging based multifunctional flame monitoring system , 2004, IEEE Transactions on Instrumentation and Measurement.

[5]  Richard Szeliski,et al.  Handling occlusions in dense multi-view stereo , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Tomaso Poggio,et al.  A Theory of Human Stereo Vision , 1977 .

[7]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[8]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[9]  Zixue Luo,et al.  A Combustion-Monitoring System With 3-D Temperature Reconstruction Based on Flame-Image Processing Technique , 2007, IEEE Transactions on Instrumentation and Measurement.

[10]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[11]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[12]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[13]  Marcus A. Magnor,et al.  Image-based tomographic reconstruction of flames , 2004, SIGGRAPH '04.

[14]  Xiaojun Wu,et al.  Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video , 2004, Comput. Vis. Image Underst..

[15]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[16]  H. Knutsson,et al.  Estimating Multiple Depths in Semi-transparent Stereo Images , 1999 .

[17]  Lars Kai Hansen,et al.  Approximate L0 constrained non-negative matrix and tensor factorization , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[18]  Hongbin Zha,et al.  Mahalanobis Distance Based Non-negative Sparse Representation for Face Recognition , 2009, 2009 International Conference on Machine Learning and Applications.

[19]  Yong Yan,et al.  Three-Dimensional Tomographic Reconstruction of the Luminosity Distribution of a Combustion Flame , 2007, IEEE Transactions on Instrumentation and Measurement.

[20]  Kiriakos N. Kutulakos,et al.  Photo-Consistent Reconstruction of Semitransparent Scenes by Density-Sheet Decomposition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[22]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, ACM Trans. Graph..

[23]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[24]  Gabor T. Herman,et al.  Fundamentals of Computerized Tomography: Image Reconstruction from Projections , 2009, Advances in Pattern Recognition.

[25]  Michael Elad,et al.  Applications of Sparse Representation and Compressive Sensing , 2010, Proc. IEEE.

[26]  W. X. Lu,et al.  Surface reconstruction of 3D objects in computerized tomography , 1988, Comput. Vis. Graph. Image Process..

[27]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[28]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[29]  Paul A. Viola,et al.  Roxels: responsibility weighted 3D volume reconstruction , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[30]  Jeppe Revall Frisvad,et al.  Efficient light scattering through thin semi-transparent objects , 2005, GRAPHITE '05.

[31]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Michael B. Wakin,et al.  An Introduction To Compressive Sampling [A sensing/sampling paradigm that goes against the common knowledge in data acquisition] , 2008 .

[33]  José Santos-Victor,et al.  Algebraic Aspects of Reconstruction of 3D Scenes from One or More Views , 2001, BMVC.

[34]  Michael Elad,et al.  On the Uniqueness of Nonnegative Sparse Solutions to Underdetermined Systems of Equations , 2008, IEEE Transactions on Information Theory.

[35]  Ran He,et al.  Nonnegative sparse coding for discriminative semi-supervised learning , 2011, CVPR 2011.

[36]  Hamid R. Arabnia,et al.  Survey on 3D Surface Reconstruction , 2016, J. Inf. Process. Syst..

[37]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[38]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Ran He,et al.  Two-Stage Sparse Representation for Robust Recognition on Large-Scale Database , 2010, AAAI.

[41]  Roger Crawfis,et al.  On Perception of Semi‐Transparent Streamlines for Three‐Dimensional Flow Visualization , 2014, Comput. Graph. Forum.