Deep-Learning High-Dynamic-Range Ultrasound

In recent years ultrasound imaging has achieved an increasing acceptance across medical specialties. For this reason new techniques keep being tested in the field. Among these techniques we found High Dynamic Range (HDR) imaging where the range of luminosity levels is augmented by combining multiple expositions of a scene. Current ultrasound techniques present limitations that are not compatible with traditional implementations of HDR imaging. In this paper, we asses the use of a deep learning (DL) neural network (U-net architecture) on predicting HDR values from low dynamic range (LDR) input images. In addition, an image acquisition pipeline to create the data set from which the network was trained is described. We demonstrated that this type of networks can be trained to predict HDR out from a minimal number of input expositions, while the obtained results showed to be comparable with more traditional approaches.

[1]  Patrick Le Callet,et al.  HDR-VQM: An objective quality measure for high dynamic range video , 2015, Signal Process. Image Commun..

[2]  Robert B. Fisher,et al.  Hypermedia image processing reference , 1996 .

[3]  Shree K. Nayar,et al.  What is the space of camera response functions? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Nassir Navab,et al.  Deep Learning Beamforming for Sub-Sampled Ultrasound Data , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[5]  Fabián Narváez,et al.  An open access thyroid ultrasound image database , 2015, Other Conferences.

[6]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[7]  Gabriel Eilertsen,et al.  HDR image reconstruction from a single exposure using deep CNNs , 2017, ACM Trans. Graph..

[8]  Hao Li,et al.  High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Robert D. Howe,et al.  High dynamic range ultrasound imaging , 2018, International Journal of Computer Assisted Radiology and Surgery.

[12]  Thomas Bashford-Rogers,et al.  ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Content , 2018, Comput. Graph. Forum.

[13]  A. Samir,et al.  Machine learning for medical ultrasound: status, methods, and future opportunities , 2018, Abdominal Radiology.

[14]  Woo-Jin Song,et al.  CNN-based LDR-to-HDR conversion system , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[15]  Hassan Rivaz,et al.  High-Dynamic-Range Ultrasound: Application for Imaging Tendon Pathology. , 2018, Ultrasound in medicine & biology.

[16]  J. Astola,et al.  ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS , 2007 .