Convolutional Neural Network (CNN) vs Vision Transformer (ViT) for Digital Holography

In Digital Holography (DH), it is crucial to extract the object distance from a hologram in order to reconstruct its amplitude and phase. This step is called auto-focusing and it is conventionally solved by first reconstructing a stack of images and then by sharpening each reconstructed image using a focus metric such as entropy or variance. The distance corresponding to the sharpest image is considered the focal position. This approach, while effective, is computationally demanding and time-consuming. In this paper, the determination of the distance is performed by Deep Learning (DL). Two deep learning (DL) architectures are compared: Convolutional Neural Network (CNN) and Vision transformer (ViT). ViT and CNN are used to cope with the problem of auto-focusing as a classification problem. Compared to a first attempt [1] in which the distance between two consecutive classes was 100μm, our proposal allows us to drastically reduce this distance to 1μm. Moreover, ViT reaches similar accuracy and is more robust than CNN.

[1]  Hazar A. İlhan,et al.  Digital holographic microscopy and focusing methods based on image sharpness , 2014, Journal of microscopy.

[2]  Edmund Y. Lam,et al.  Learning-based nonparametric autofocusing for digital holography , 2018 .

[3]  Myung K. Kim Principles and techniques of digital holographic microscopy , 2010 .

[4]  Thomas J. Naughton,et al.  Focus classification in digital holographic microscopy using deep convolutional neural networks , 2017, European Conference on Biomedical Optics.

[5]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Indranil Acharya,et al.  Comparative Study of Digital Holography Reconstruction Methods , 2015 .

[7]  Adding Binary Search Connections to Improve DenseNet Performance , 2020 .

[8]  Tomoyoshi Shimobaba,et al.  Convolutional Neural Network-Based Regression for Depth Prediction in Digital Holography , 2018, 2018 IEEE 27th International Symposium on Industrial Electronics (ISIE).

[9]  Edmund Y. Lam,et al.  Autofocusing in digital holography using deep learning , 2018, BiOS.

[10]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[11]  Thomas J. Naughton,et al.  Performance of autofocus capability of deep convolutional neural networks in digital holographic microscopy , 2016 .

[12]  Salvador Pané,et al.  Real-Time Holographic Tracking and Control of Microrobots , 2016, IEEE Robotics and Automation Letters.

[13]  Georg Heigold,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2021, ICLR.

[14]  Shanqing Gu,et al.  Improve Image Classification Using Data Augmentation and Neural Networks , 2019 .

[15]  R. Couturier,et al.  Using Deep Learning for Object Distance Prediction in Digital Holography , 2021, 2021 International Conference on Computer, Control and Robotics (ICCCR).