Transcending shift-invariance in the paraxial regime via end-to-end inverse design of freeform nanophotonics

Traditional optical elements and conventional metasurfaces obey shift-invariance in the paraxial regime. For imaging systems obeying paraxial shift-invariance, a small shift in input angle causes a corresponding shift in the sensor image. Shift-invariance has deep implications for the design and functionality of optical devices, such as the necessity of free space between components (as in compound objectives made of several curved surfaces). We present a method for nanophotonic inverse design of compact imaging systems whose resolution is not constrained by paraxial shift-invariance. Our method is end-to-end, in that it integrates density-based full-Maxwell topology optimization with a fully iterative elastic-net reconstruction algorithm. By the design of nanophotonic structures that scatter light in a non-shift-invariant manner, our optimized nanophotonic imaging system overcomes the limitations of paraxial shift-invariance, achieving accurate, noise-robust image reconstruction beyond shift-invariant resolution.

[1]  A. Alú,et al.  Diffractive Nonlocal Metasurfaces , 2022, Laser & Photonics Reviews.

[2]  Zin Lin,et al.  End-to-End Optimization of Metasurfaces for Imaging with Compressed Sensing , 2022, 2201.12348.

[3]  Alec M. Hammond,et al.  High-performance hybrid time/frequency-domain topology optimization for large-scale photonics inverse design. , 2022, Optics express.

[4]  Steven G. Johnson,et al.  End-to-end metasurface inverse design for single-shot multi-channel imaging. , 2021, Optics express.

[5]  Alec M. Hammond,et al.  Photonic topology optimization with semiconductor-foundry design-rule constraints. , 2021, Optics express.

[6]  Felix Heide,et al.  Supplementary Information Differentiable Compound Optics and Processing Pipeline Optimization for End-to-end Camera Design , 2021 .

[7]  F. Capasso,et al.  Multifunctional wide-angle optics and lasing based on supercell metasurfaces , 2021, Nature Communications.

[8]  O. Sigmund,et al.  Inverse design in photonics by topology optimization: tutorial , 2021, Journal of the Optical Society of America B.

[9]  R. Boyd,et al.  An optic to replace space and its application towards ultra-thin imaging systems , 2020, Nature Communications.

[10]  Michael R. Kellman,et al.  Physics-Based Learned Diffuser for Single-shot 3D Imaging , 2021 .

[11]  W. Joseph,et al.  Introduction To Fourier Optics 3rd Edition 2007 Joseph W , 2021 .

[12]  Steven G. Johnson,et al.  Computational inverse design for ultra-compact single-piece metalenses free of chromatic and angular aberration , 2020, 2011.10467.

[13]  Laura Waller,et al.  Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy , 2020, Light: Science & Applications.

[14]  Steven G. Johnson,et al.  Fullwave Maxwell inverse design of axisymmetric, tunable, and multi-scale multi-wavelength metalenses. , 2020, Optics express.

[15]  Steven G. Johnson,et al.  End-to-end nanophotonic inverse design for imaging and polarimetry , 2020 .

[16]  U. Levy,et al.  The advantages of metalenses over diffractive lenses , 2020, Nature Communications.

[17]  Bernard Ghanem,et al.  End-to-end Learned, Optically Coded Super-resolution SPAD Camera , 2020, ACM Trans. Graph..

[18]  S. Fan,et al.  Squeeze free space with nonlocal flat optics , 2020, Optica.

[19]  Alexandre Gramfort,et al.  Implicit differentiation of Lasso-type models for hyperparameter optimization , 2020, ICML.

[20]  Stephen P. Boyd,et al.  End-to-end optimization of optics and image processing for achromatic extended depth of field and super-resolution imaging , 2018, ACM Trans. Graph..

[21]  Jelena Vucković,et al.  Inverse design in nanophotonics , 2018, Nature Photonics.

[22]  Bernard Ghanem,et al.  ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Ramesh Raskar,et al.  Lensless Imaging With Compressive Ultrafast Sensing , 2016, IEEE Transactions on Computational Imaging.

[24]  W. T. Chen,et al.  Metalenses at visible wavelengths: Diffraction-limited focusing and subwavelength resolution imaging , 2016, Science.

[25]  Houtong Chen,et al.  A review of metasurfaces: physics and applications , 2016, Reports on progress in physics. Physical Society.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  A. Arbabi,et al.  Dielectric metasurfaces for complete control of phase and polarization with subwavelength spatial resolution and high transmission. , 2014, Nature nanotechnology.

[28]  N. Yu,et al.  Flat optics with designer metasurfaces. , 2014, Nature materials.

[29]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[30]  Steven G. Johnson,et al.  Meep: A flexible free-software package for electromagnetic simulations by the FDTD method , 2010, Comput. Phys. Commun..

[31]  O. Sigmund,et al.  Topology optimization for nano‐photonics , 2011 .

[32]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[33]  O. SIAMJ.,et al.  A CLASS OF GLOBALLY CONVERGENT OPTIMIZATION METHODS BASED ON CONSERVATIVE CONVEX SEPARABLE APPROXIMATIONS∗ , 2002 .

[34]  J. Goodman Introduction to Fourier optics , 1969 .