Radiative Transport Based Flame Volume Reconstruction from Videos

We introduce a novel approach for flame volume reconstruction from videos using inexpensive charge-coupled device (CCD) consumer cameras. The approach includes an economical data capture technique using inexpensive CCD cameras. Leveraging the smear feature of the CCD chip, we present a technique for synchronizing CCD cameras while capturing flame videos from different views. Our reconstruction is based on the radiative transport equation which enables complex phenomena such as emission, extinction, and scattering to be used in the rendering process. Both the color intensity and temperature reconstructions are implemented using the CUDA parallel computing framework, which provides real-time performance and allows visualization of reconstruction results after every iteration. We present the results of our approach using real captured data and physically-based simulated data. Finally, we also compare our approach against the other state-of-the-art flame volume reconstruction methods and demonstrate the efficacy and efficiency of our approach in four different applications: (1) rendering of reconstructed flames in virtual environments, (2) rendering of reconstructed flames in augmented reality, (3) flame stylization, and (4) reconstruction of other semitransparent phenomena.

[1]  A. Agrawal,et al.  Schlieren analysis of an oscillating gas-jet diffusion flame , 1999 .

[2]  Marcus A. Magnor,et al.  Image-based tomographic reconstruction of flames , 2004, SIGGRAPH '04.

[3]  Louis Bavoil,et al.  Order Independent Transparency with Dual Depth Peeling , 2008 .

[4]  P. Ferrão,et al.  Advanced 3D Emission Tomography Flame Temperature Sensor , 2001 .

[5]  Hans-Peter Seidel,et al.  Property and Lighting Manipulations for Static Volume Stylization Using a Painting Metaphor , 2014, IEEE Transactions on Visualization and Computer Graphics.

[6]  F. Natterer The Mathematics of Computerized Tomography , 1986 .

[7]  Kiriakos N. Kutulakos,et al.  Photo-consistent 3D fire by Flame-Sheet decomposition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Cheng Lei,et al.  Tri-focal tensor-based multiple video synchronization with subframe optimization , 2006, IEEE Transactions on Image Processing.

[9]  Wolfgang Heidrich,et al.  Stochastic tomography and its applications in 3D imaging of mixing fluids , 2012, ACM Trans. Graph..

[10]  Wu Donglou,et al.  Use of Moire Tomography to Measure the Temperature Field of the Flame of a Pyrotechnical Composition from Its Infrared Radiation , 2001 .

[11]  Holly E. Rushmeier,et al.  Volume rendering of pool fire data , 1995, IEEE Computer Graphics and Applications.

[12]  A Schwarz,et al.  Multi-tomographic flame analysis with a schlieren apparatus , 1996 .

[13]  Ken D. Sauer,et al.  Adaptive wavelet graph model for Bayesian tomographic reconstruction , 2002, IEEE Trans. Image Process..

[14]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Hans Weda,et al.  Synchronization of multiple video recordings based on still camera flashes , 2006, MM '06.

[16]  Wolfgang Heidrich,et al.  From capture to simulation , 2014, ACM Trans. Graph..

[17]  Kiriakos N. Kutulakos,et al.  Linear Sequence-to-Sequence Alignment , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  BradleyDerek,et al.  Time-resolved 3d capture of non-stationary gas flows , 2008 .

[19]  A. Kak,et al.  Simultaneous Algebraic Reconstruction Technique (SART): A Superior Implementation of the Art Algorithm , 1984, Ultrasonic imaging.

[20]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[21]  Yi Hong,et al.  Geometry-based control of fire simulation , 2010, The Visual Computer.

[22]  Ken-ichi Anjyo,et al.  Fluid volume modeling from sparse multi-view images by appearance transfer , 2015, ACM Trans. Graph..

[23]  Hans-Peter Seidel,et al.  Time-resolved 3d capture of non-stationary gas flows , 2008, SIGGRAPH Asia '08.

[24]  Kevin B. McGrattan,et al.  An Examination of the Applicability of Computed Tomography for the Measurement of Component Concentrations in Fire-Generated Plumes , 1998 .

[25]  Hans-Christian Hege,et al.  Fast Generation of Virtual X-ray Images for Reconstruction of 3D Anatomy , 2013, IEEE Transactions on Visualization and Computer Graphics.

[26]  Duc Quang Nguyen,et al.  Physically based modeling and animation of fire , 2002, ACM Trans. Graph..

[27]  Zixue Luo,et al.  A Combustion-Monitoring System With 3-D Temperature Reconstruction Based on Flame-Image Processing Technique , 2007, IEEE Transactions on Instrumentation and Measurement.

[28]  Daniel Sbarbaro,et al.  Flame spectra-temperature estimation based on a color imaging camera and a spectral reconstruction technique. , 2014, Applied optics.

[29]  Y. Ishihara,et al.  Smear reduction in the interline CCD image sensor , 1987, IEEE Transactions on Electron Devices.

[30]  Derek Bradley,et al.  Synchronization and rolling shutter compensation for consumer video camera arrays , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[31]  Klaus Mueller,et al.  Visual Simulation of Heat Shimmering and Mirage , 2007, IEEE Transactions on Visualization and Computer Graphics.

[32]  Steven G. Parker,et al.  Physically-Based Realistic Fire Rendering , 2006, NPH.

[33]  Kiriakos N. Kutulakos,et al.  Photo-Consistent Reconstruction of Semitransparent Scenes by Density-Sheet Decomposition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  J. Meseguer,et al.  Thermal radiation heat transfer , 2012 .

[35]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[36]  Marcus A. Magnor,et al.  Adaptive grid optical tomography , 2006, Graph. Model..

[37]  Philip J. Willis,et al.  Water Surface Modeling from a Single Viewpoint Video , 2013, IEEE Transactions on Visualization and Computer Graphics.

[38]  Xin Li,et al.  Subframe Video Synchronization via 3D Phase Correlation , 2006, 2006 International Conference on Image Processing.

[39]  Zhong Zhou,et al.  3-D Reconstruction of Flame Temperature Distribution Using Tomographic and Two-Color Pyrometric Techniques , 2015, IEEE Transactions on Instrumentation and Measurement.

[40]  Yong Yan,et al.  Tomographic imaging based measurement of three-dimensional geometric parameters of a burner flame , 2014, 2014 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[41]  Ivo Ihrke,et al.  Reconstruction and rendering of time varying natural phenomena , 2007 .

[42]  Zhong Zhou,et al.  Reconstruction of three-dimensional flame with color temperature , 2014, The Visual Computer.

[43]  Francisco J. Serón,et al.  Implementation of a method of curved ray tracing for inhomogeneous atmospheres , 2005, Comput. Graph..

[44]  Lin Ma,et al.  Three-dimensional flame measurements using fiber-based endoscopes , 2015 .

[45]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Zhiheng Wang,et al.  Image based temperature field reconstruction for combustion flame , 2015 .

[47]  Sarah Eichmann,et al.  The Radon Transform And Some Of Its Applications , 2016 .

[48]  María Isabel Suero,et al.  Influence of the correlated color temperature of a light source on the color discrimination capacity of the observer. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.