Medical transformer for multimodal survival prediction in intensive care: integration of imaging and non-imaging data

[1]  Jakob Nikolas Kather,et al.  Artificial Intelligence for Clinical Interpretation of Bedside Chest Radiographs. , 2022, Radiology.

[2]  P. Milanfar,et al.  MaxViT: Multi-Axis Vision Transformer , 2022, ECCV.

[3]  Jakob Nikolas Kather,et al.  Adversarial attacks and adversarial robustness in computational pathology , 2022, bioRxiv.

[4]  P. Mildenberger,et al.  Multimodal Deep Learning for Prognosis Prediction in Renal Cancer , 2021, Frontiers in Oncology.

[5]  Jakob Nikolas Kather,et al.  Swarm learning for decentralized artificial intelligence in cancer histopathology , 2021, Nature Medicine.

[6]  Ross B. Girshick,et al.  Masked Autoencoders Are Scalable Vision Learners , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Farah E. Shamout,et al.  Towards dynamic multi-modal phenotyping using chest radiographs and physiological data , 2021, ArXiv.

[8]  Christian Wachinger,et al.  Combining 3D Image and Tabular Data via the Dynamic Affine Feature Map Transform , 2021, MICCAI.

[9]  Zhenfeng Zhu,et al.  Multi-Modal Graph Learning for Disease Prediction , 2021, IEEE Transactions on Medical Imaging.

[10]  Fei Li,et al.  Deep Relation Transformer for Diagnosing Glaucoma With Optical Coherence Tomography and Visual Field Function , 2021, IEEE Transactions on Medical Imaging.

[11]  Matthew B. Blaschko,et al.  CLIMAT: Clinically-Inspired Multi-Agent Transformers for Knee Osteoarthritis Trajectory Forecasting , 2021, 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI).

[12]  Maryam Garza,et al.  Application of Machine Learning in Intensive Care Unit (ICU) Settings Using MIMIC Dataset: Systematic Review , 2021, Informatics.

[13]  Matthew P. Lungren,et al.  Multimodal fusion with deep neural networks for leveraging CT imaging and electronic health record: a case-study in pulmonary embolism detection , 2020, Scientific Reports.

[14]  S. Gelly,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2020, ICLR.

[15]  Zhikui Chen,et al.  A Survey on Deep Learning for Multimodal Data Fusion , 2020, Neural Computation.

[16]  B. Hamm,et al.  Comparing different deep learning architectures for classification of chest radiographs , 2020, Scientific Reports.

[17]  Shivajirao M. Jadhav,et al.  Deep convolutional neural network based medical image classification for disease diagnosis , 2019, Journal of Big Data.

[18]  Steven Horng,et al.  MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports , 2019, Scientific Data.

[19]  Hamid Reza Vaezi Joze,et al.  MMTM: Multimodal Transfer Module for CNN Fusion , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Tatsuhiko Tsunoda,et al.  DeepInsight: A methodology to transform a non-image data to an image for convolution neural network architecture , 2019, Scientific Reports.

[21]  Yifan Yu,et al.  CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison , 2019, AAAI.

[22]  L. Ungar,et al.  Inclusion of Unstructured Clinical Text Improves Early Prediction of Death or Prolonged ICU Stay* , 2018, Critical care medicine.

[23]  Mohamed Bader-El-Den,et al.  Early hospital mortality prediction of intensive care unit patients using an ensemble learning approach , 2017, Int. J. Medical Informatics.

[24]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[25]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[27]  Ilker Ünal,et al.  Defining an Optimal Cut-Point Value in ROC Analysis: An Alternative Approach , 2017, Comput. Math. Methods Medicine.

[28]  David C. Kale,et al.  Multitask learning and benchmarking with clinical time series data , 2017, Scientific Data.

[29]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[30]  Mark Hoogendoorn,et al.  Prediction using patient comparison vs. modeling: A case study for mortality prediction , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[31]  S. Padley,et al.  Chest X-ray interpretation in UK intensive care units: A survey 2014 , 2015, Journal of the Intensive Care Society.

[32]  W. Self,et al.  High discordance of chest x-ray and computed tomography for detection of pulmonary opacities in ED patients: implications for diagnosing pneumonia. , 2013, The American journal of emergency medicine.

[33]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[34]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[35]  N. Halpern,et al.  Critical care medicine in the United States 2000–2005: An analysis of bed numbers, occupancy rates, payer mix, and costs* , 2010, Critical care medicine.

[36]  T. Yoshizumi,et al.  Radiologic and nuclear medicine studies in the United States and worldwide: frequency, radiation dose, and comparison with other radiation sources--1950-2007. , 2009, Radiology.

[37]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[39]  M. J. van der Laan,et al.  Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): a population-based study. , 2015, The Lancet. Respiratory medicine.

[40]  Frank Konietschke,et al.  Bootstrapping and permuting paired t-test type statistics , 2014, Stat. Comput..

[41]  Stephen Wright,et al.  An alternative approach. , 2010, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[42]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.