Computed stereo lensless X-ray imaging

Recovering the three-dimensional (3D) properties of artificial or biological systems using low X-ray doses is challenging as most techniques are based on computing hundreds of two-dimensional (2D) projections. The requirement for a low X-ray dose also prevents single-shot 3D imaging using ultrafast X-ray sources. Here we show that computed stereo vision concepts can be applied to X-rays. Stereo vision is important in the field of machine vision and robotics. We reconstruct two X-ray stereo views from coherent diffraction patterns and compute a nanoscale 3D representation of the sample from disparity maps. Similarly to brain perception, computed stereo vision algorithms use constraints. We demonstrate that phase-contrast images relax the disparity constraints, allowing occulted features to be revealed. We also show that by using nanoparticles as labels we can extend the applicability of the technique to complex samples. Computed stereo X-ray imaging will find application at X-ray free-electron lasers, synchrotrons and laser-based sources, and in industrial and medical 3D diagnosis methods.Stereo images of gold nanoparticles in a pyramid shape are reconstructed from X-ray coherent diffraction patterns. Depth information is retrieved by computing disparity maps without a priori knowledge of the sample shape.

[1]  P. Zeitoun,et al.  Laser-induced ultrafast demagnetization in the presence of a nanoscale magnetic domain network , 2012, Nature Communications.

[2]  Hitoshi Tanaka,et al.  The next ten years of X-ray science , 2017, Nature Photonics.

[3]  O. Bunk,et al.  High-Resolution Scanning X-ray Diffraction Microscopy , 2008, Science.

[4]  Isaac Amidror,et al.  Scattered data interpolation methods for electronic imaging systems: a survey , 2002, J. Electronic Imaging.

[5]  Veit Elser.  Phase retrieval by iterated projections. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Takashi Kameshima,et al.  Macromolecular structures probed by combining single-shot free-electron laser diffraction with synchrotron coherent X-ray imaging , 2014, Nature Communications.

[7]  T. Ekeberg.  Three-Dimensional Reconstruction of the Giant Mimivirus Particle with an X-Ray Free-Electron Laser (CXIDB ID 30) , 2015 .

[8]  W. H. Benner,et al.  Femtosecond diffractive imaging with a soft-X-ray free-electron laser , 2006, physics/0610044.

[9]  W. Chao,et al.  Stereo soft X‐ray microscopy and elemental mapping of haematite and clay suspensions , 2009, Journal of microscopy.

[10]  Tim J. Dennis,et al.  Epipolar line estimation and rectification for stereo image pairs , 1996, IEEE Trans. Image Process..

[11]  Kentaro Uesugi,et al.  Development of an X-ray real-time stereo imaging technique using synchrotron radiation , 2011, Journal of synchrotron radiation.

[12]  J. Grover,et al.  Seasonal dynamics of phytoplankton in two warm temperate reservoirs: association of taxonomic composition with temperature , 2006 .

[13]  J. Kirz,et al.  An assessment of the resolution limitation due to radiation-damage in x-ray diffraction microscopy. , 2005, Journal of Electron Spectroscopy and Related Phenomena.

[14]  Anton Barty,et al.  Natively Inhibited Trypanosoma brucei Cathepsin B Structure Determined by Using an X-ray Laser , 2013, Science.

[15]  O. Bunk,et al.  Ptychographic X-ray computed tomography at the nanoscale , 2010, Nature.

[16]  D. Garzella,et al.  Single-shot diffractive imaging with a table-top femtosecond soft x-ray laser-harmonics source. , 2009, Physical review letters.

[17]  T. Ishikawa,et al.  Three-dimensional electron density mapping of shape-controlled nanoparticle by focused hard X-ray diffraction microscopy. , 2010, Nano letters.

[18]  S. Marchesini,et al.  High-resolution ab initio three-dimensional x-ray diffraction microscopy. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  I. Bukreeva,et al.  3D imaging of theranostic nanoparticles in mice organs by means of x-ray phase contrast tomography , 2018, Medical Imaging.

[20]  O. Bunk,et al.  An instrument for 3D x-ray nano-imaging. , 2012, The Review of scientific instruments.

[21]  Irwin Sobel,et al.  An Isotropic 3×3 image gradient operator , 1990 .

[22]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  S. Marchesini,et al.  Ultrafast single-shot diffraction imaging of nanoscale dynamics , 2008 .

[24]  J R Fienup,et al.  Single-shot femtosecond x-ray holography using extended references. , 2010, Physical review letters.

[25]  Luigi Rigon,et al.  Gold nanoparticle labeling of cells is a sensitive method to investigate cell distribution and migration in animal models of human disease. , 2011, Nanomedicine : nanotechnology, biology, and medicine.

[26]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[27]  Alexander Katsevich,et al.  Fundamental limits of ‘ankylography’ due to dimensional deficiency , 2010, Nature.

[28]  Tetsuya Ishikawa,et al.  Three-dimensional visualization of a human chromosome using coherent X-ray diffraction. , 2009, Physical review letters.

[29]  U Weierstall,et al.  Tomographic femtosecond x-ray diffractive imaging. , 2008, Physical review letters.

[30]  Carlos Hernandez,et al.  Multi-View Stereo: A Tutorial , 2015, Found. Trends Comput. Graph. Vis..

[31]  J. Miao,et al.  Beyond crystallography: Diffractive imaging using coherent x-ray light sources , 2015, Science.

[32]  Garth J. Williams,et al.  Single mimivirus particles intercepted and imaged with an X-ray laser , 2011, Nature.

[33]  Garth J. Williams,et al.  Multiple wavelength diffractive imaging. , 2009 .

[34]  J. Miao,et al.  High resolution 3D x-ray diffraction microscopy. , 2002, Physical review letters.

[35]  M. Geisen,et al.  Stereo-microscopy of coccolithophores - modern applications for imaging and morphological analysis , 2006 .

[36]  Kazuto Yamauchi,et al.  Wavelength-tunable split-and-delay optical system for hard X-ray free-electron lasers. , 2016, Optics express.

[37]  Sebastiano Battiato,et al.  Adaptive Compression of Stereoscopic Images , 2013, ICIAP.

[38]  Manuel Guizar-Sicairos,et al.  Efficient subpixel image registration algorithms. , 2008, Optics letters.

[39]  S. Eisebitt,et al.  Development of a hard X-ray split-and-delay line and performance simulations for two-color pump-probe experiments at the European XFEL. , 2018, The Review of scientific instruments.

[40]  Three-dimensional imaging of a phase object from a single sample orientation using an optical laser , 2011, 1107.3276.

[41]  O. Tillement,et al.  3D map of theranostic nanoparticles distribution in mice brain and liver by means of X-ray Phase Contrast Tomography , 2018 .

[42]  Masaki Yamamoto,et al.  Single-shot three-dimensional structure determination of nanocrystals with femtosecond X-ray free-electron laser pulses. , 2013, Nature communications.