Patient Information Summarization in Clinical Settings: Scoping Review

Background Information overflow, a common problem in the present clinical environment, can be mitigated by summarizing clinical data. Although there are several solutions for clinical summarization, there is a lack of a complete overview of the research relevant to this field. Objective This study aims to identify state-of-the-art solutions for clinical summarization, to analyze their capabilities, and to identify their properties. Methods A scoping review of articles published between 2005 and 2022 was conducted. With a clinical focus, PubMed and Web of Science were queried to find an initial set of reports, later extended by articles found through a chain of citations. The included reports were analyzed to answer the questions of where, what, and how medical information is summarized; whether summarization conserves temporality, uncertainty, and medical pertinence; and how the propositions are evaluated and deployed. To answer how information is summarized, methods were compared through a new framework “collect—synthesize—communicate” referring to information gathering from data, its synthesis, and communication to the end user. Results Overall, 128 articles were included, representing various medical fields. Exclusively structured data were used as input in 46.1% (59/128) of papers, text in 41.4% (53/128) of articles, and both in 10.2% (13/128) of papers. Using the proposed framework, 42.2% (54/128) of the records contributed to information collection, 27.3% (35/128) contributed to information synthesis, and 46.1% (59/128) presented solutions for summary communication. Numerous summarization approaches have been presented, including extractive (n=13) and abstractive summarization (n=19); topic modeling (n=5); summary specification (n=11); concept and relation extraction (n=30); visual design considerations (n=59); and complete pipelines (n=7) using information extraction, synthesis, and communication. Graphical displays (n=53), short texts (n=41), static reports (n=7), and problem-oriented views (n=7) were the most common types in terms of summary communication. Although temporality and uncertainty information were usually not conserved in most studies (74/128, 57.8% and 113/128, 88.3%, respectively), some studies presented solutions to treat this information. Overall, 115 (89.8%) articles showed results of an evaluation, and methods included evaluations with human participants (median 15, IQR 24 participants): measurements in experiments with human participants (n=31), real situations (n=8), and usability studies (n=28). Methods without human involvement included intrinsic evaluation (n=24), performance on a proxy (n=10), or domain-specific tasks (n=11). Overall, 11 (8.6%) reports described a system deployed in clinical settings. Conclusions The scientific literature contains many propositions for summarizing patient information but reports very few comparisons of these proposals. This work proposes to compare these algorithms through how they conserve essential aspects of clinical information and through the “collect—synthesize—communicate” framework. We found that current propositions usually address these 3 steps only partially. Moreover, they conserve and use temporality, uncertainty, and pertinent medical aspects to varying extents, and solutions are often preliminary.

[1]  R. Shah,et al.  Registration of Bony Landmarks and Soft Tissue Laxity during Robotic Total Knee Arthroplasty is Highly Reproducible. , 2022, Surgical technology international.

[2]  T. Salakoski,et al.  Text Classification Model Explainability for Keyword Extraction - Towards Keyword-Based Summarization of Nursing Care Episodes , 2022, MedInfo.

[3]  B. Luo,et al.  Extracting keyframes of breast ultrasound video using deep reinforcement learning , 2022, Medical Image Anal..

[4]  Justin F. Rousseau,et al.  EchoGen: Generating Conclusions from Echocardiogram Notes , 2022, BIONLP.

[5]  D. Weiskopf,et al.  Visual Analytics of Multivariate Intensive Care Time Series Data , 2022, Comput. Graph. Forum.

[6]  Tsung-Hui Chang,et al.  Graph Enhanced Contrastive Learning for Radiology Findings Summarization , 2022, ACL.

[7]  Tsung-Hui Chang,et al.  Word Graph Guided Summarization for Radiology Findings , 2021, FINDINGS.

[8]  Stephen Kay,et al.  The International Patient Summary and the Summarization Requirement , 2021, pHealth.

[9]  Javed Mostafa,et al.  A systematic review of automatic text summarization for biomedical literature and EHRs , 2021, J. Am. Medical Informatics Assoc..

[10]  Dragomir R. Radev,et al.  Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Review , 2021, Comput. Sci. Rev..

[11]  Utku Pamuksuz,et al.  Customized Impression Prediction From Radiology Reports Using BERT and LSTMs , 2021, IEEE Transactions on Artificial Intelligence.

[12]  Lawrence Carin,et al.  SpanPredict: Extraction of Predictive Document Spans with Neural Attention , 2021, NAACL.

[13]  Robyn L. Miller,et al.  Multiframe Evolving Dynamic Functional Connectivity (EVOdFNC): A Method for Constructing and Investigating Functional Brain Motifs , 2021, bioRxiv.

[14]  Parminder Bhatia,et al.  Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior Notes , 2021, ArXiv.

[15]  Giuseppe Rizzo,et al.  Attention-based clinical note summarization , 2021, SAC.

[16]  Noémie Elhadad,et al.  What’s in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization , 2021, NAACL.

[17]  M. Gity,et al.  A Practical, Clinical User-Friendly Format for Breast Ultrasound Report. , 2021, European journal of breast health.

[18]  E. Steyerberg,et al.  The digital scribe in clinical practice: a scoping review and research agenda , 2021, npj Digital Medicine.

[19]  Ahmed A. Rafea,et al.  Automatic text summarization: A comprehensive survey , 2021, Expert Syst. Appl..

[20]  Arputharaj Kannan,et al.  Classifying unevenly spaced clinical time series data using forecast error approximation based bottom-up (FeAB) segmented time delay neural network , 2020, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[21]  Jonah Kenei,et al.  Visualizing Semantic Structure of a Clinical Text Document , 2020 .

[22]  Eva K. Lee,et al.  CERC: an interactive content extraction, recognition, and construction tool for clinical and biomedical text , 2020, BMC Medical Informatics and Decision Making.

[23]  S. Mitchell,et al.  Using Timeline Methodology to Visualize Treatment Trajectories of Youth and Young Adults Following Inpatient Opioid Treatment , 2020 .

[24]  Chenhao Tan,et al.  Characterizing the Value of Information in Medical Notes , 2020, FINDINGS.

[25]  E. Mayo-Wilson,et al.  The PRISMA 2020 statement: an updated guideline for reporting systematic reviews , 2020, BMJ.

[26]  Shaohui Mei,et al.  Keyframe Extraction From Laparoscopic Videos via Diverse and Weighted Dictionary Selection , 2020, IEEE Journal of Biomedical and Health Informatics.

[27]  C. Brandt,et al.  Incorporating Domain Knowledge Into Language Models by Using Graph Convolutional Networks for Assessing Semantic Textual Similarity: Model Development and Performance Comparison , 2020, JMIR medical informatics.

[28]  Rem W. Collier,et al.  An Evaluation of Graphical Formats for the Summary of Activities of Daily Living (ADLs) , 2020, Healthcare.

[29]  Krishnaprasad Thirunarayan,et al.  Knowledge-Infused Abstractive Summarization of Clinical Diagnostic Interviews: Framework Development Study , 2020, JMIR mental health.

[30]  Marta Avalos Fernandez,et al.  Pre-Training A Neural Language Model Improves the Sample Efficiency of an Emergency Room Classification Model , 2020, FLAIRS.

[31]  Nazli Goharian,et al.  Attend to Medical Ontologies: Content Selection for Clinical Abstractive Summarization , 2020, ACL.

[32]  Nimit K Lad,et al.  Patient Safety Issues From Information Overload in Electronic Medical Records , 2020, Journal of patient safety.

[33]  Byron C. Wallace,et al.  Query-Focused EHR Summarization to Aid Imaging Diagnosis , 2020, MLHC.

[34]  Vince D. Calhoun,et al.  Frequency-Aware Summarization of Resting-State fMRI Data , 2020, Frontiers in Systems Neuroscience.

[35]  M. Danieletto,et al.  Deep representation learning of electronic health records to unlock patient stratification at scale , 2020, npj Digital Medicine.

[36]  Gal Levy-Fix,et al.  Towards Patient Record Summarization Through Joint Phenotype Learning in HIV Patients , 2020, ArXiv.

[37]  Serguei V. S. Pakhomov,et al.  Natural language processing of prehospital emergency medical services trauma records allows for automated characterization of treatment appropriateness , 2020, The journal of trauma and acute care surgery.

[38]  F. Lai,et al.  Modified Bidirectional Encoder Representations From Transformers Extractive Summarization Model for Hospital Information Systems Based on Character-Level Tokens (AlphaBERT): Development and Performance Evaluation , 2020, JMIR medical informatics.

[39]  Cristiana Larizza,et al.  Patient-Generated Health Data Integration and Advanced Analytics for Diabetes Management: The AID-GM Platform , 2019, Sensors.

[40]  Peter J. Liu,et al.  PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization , 2019, ICML.

[41]  Christopher D. Manning,et al.  Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reports , 2019, ACL.

[42]  Omer Levy,et al.  BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension , 2019, ACL.

[43]  Jorge A. Gálvez,et al.  A Visual Analytics Dashboard to Summarize Serial Anesthesia Records in Pediatric Radiation Treatment , 2019, Applied Clinical Informatics.

[44]  Guilherme Del Fiol,et al.  Critical care information display approaches and design frameworks: A systematic review and meta-analysis , 2019, J. Biomed. Informatics X.

[45]  Nazli Goharian,et al.  Ontology-Aware Clinical Abstractive Summarization , 2019, SIGIR.

[46]  Philip E. Bourne,et al.  Natural language processing of symptoms documented in free-text narratives of electronic health records: a systematic review , 2019, J. Am. Medical Informatics Assoc..

[47]  Cody Dunne,et al.  IDMVis: Temporal Event Sequence Visualization for Type 1 Diabetes Treatment Decision Support , 2019, IEEE Transactions on Visualization and Computer Graphics.

[48]  Nicole Sultanum,et al.  Doccurate: A Curation-Based Approach for Clinical Text Visualization , 2019, IEEE Transactions on Visualization and Computer Graphics.

[49]  Pengtao Xie,et al.  Unsupervised Pseudo-Labeling for Extractive Summarization on Electronic Health Records , 2018, ArXiv.

[50]  Anne Kim,et al.  Extractive Summarization of EHR Discharge Notes , 2018, ArXiv.

[51]  J. McGowan,et al.  PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation , 2018, Annals of Internal Medicine.

[52]  Liz Kellermeyer,et al.  Covidence and Rayyan , 2018, Journal of the Medical Library Association : JMLA.

[53]  Christopher D. Manning,et al.  Learning to Summarize Radiology Findings , 2018, Louhi@EMNLP.

[54]  Thomas T. Klumpner,et al.  Use of a novel electronic maternal surveillance system to generate automated alerts on the labor and delivery unit , 2018, BMC Anesthesiology.

[55]  Riccardo Bellazzi,et al.  A dashboard-based system for supporting diabetes care , 2018, J. Am. Medical Informatics Assoc..

[56]  T. Loehfelm,et al.  Automated Radiology Report Summarization Using an Open-Source Natural Language Processing Pipeline , 2018, Journal of Digital Imaging.

[57]  Guy A Dumont,et al.  Clinician-Driven Design of VitalPAD–An Intelligent Monitoring and Communication Device to Improve Patient Safety in the Intensive Care Unit , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[58]  Sachin Kheterpal,et al.  Impact of a Novel Multiparameter Decision Support System on Intraoperative Processes of Care and Postoperative Outcomes , 2018, Anesthesiology.

[59]  Constantinos Loukas,et al.  Video content analysis of surgical procedures , 2018, Surgical Endoscopy.

[60]  George Hripcsak,et al.  Estimating summary statistics for electronic health record laboratory data for use in high-throughput phenotyping algorithms , 2018, J. Biomed. Informatics.

[61]  Yasushi Kiyoki,et al.  Medical documents processing for summary generation and keywords highlighting based on natural language processing and ontology graph descriptor approach , 2017, iiWAS.

[62]  Po Hu,et al.  Abstractive Document Summarization via Neural Model with Joint Attention , 2017, NLPCC.

[63]  Abi Rimmer,et al.  Radiologist shortage leaves patient care at risk, warns royal college , 2017, British Medical Journal.

[64]  Yuval Shahar,et al.  Evaluation of an automated knowledge-based textual summarization system for longitudinal clinical data, in the intensive care domain , 2017, Artif. Intell. Medicine.

[65]  Zhihan Lv,et al.  Secure video summarization framework for personalized wireless capsule endoscopy , 2017, Pervasive Mob. Comput..

[66]  Jennifer J. Liang,et al.  Automated problem list generation and physicians perspective from a pilot study , 2017, Int. J. Medical Informatics.

[67]  Xiaojun Wan,et al.  From Neural Sentence Summarization to Headline Generation: A Coarse-to-Fine Approach , 2017, IJCAI.

[68]  Guilherme Del Fiol,et al.  Trend Displays to Support Critical Care: A Systematic Review , 2017, 2017 IEEE International Conference on Healthcare Informatics (ICHI).

[69]  Krys J. Kochut,et al.  Text Summarization Techniques: A Brief Survey , 2017, International Journal of Advanced Computer Science and Applications.

[70]  Padhraic Smyth,et al.  Content Coding of Psychotherapy Transcripts Using Labeled Topic Models , 2017, IEEE Journal of Biomedical and Health Informatics.

[71]  Russ B. Altman,et al.  Predicting inpatient clinical order patterns with probabilistic topic models vs conventional order sets , 2016, J. Am. Medical Informatics Assoc..

[72]  Sung Wook Baik,et al.  Visual saliency models for summarization of diagnostic hysteroscopy videos in healthcare systems , 2016, SpringerPlus.

[73]  E. Simmerman,et al.  Development of Electronic Medical Record-Based “Rounds Report” Results in Improved Resident Efficiency, More Time for Direct Patient Care and Education, and Less Resident Duty Hour Violations , 2016, The American surgeon.

[74]  D. Ulrich,et al.  Data Driven GUI Design and Visualization for a NGS Based Clinical Decision Support System , 2016, 2016 20th International Conference Information Visualisation (IV).

[75]  William Speier,et al.  Using phrases and document metadata to improve topic modeling of clinical reports , 2016, J. Biomed. Informatics.

[76]  Yuval Shahar,et al.  An automated knowledge-based textual summarization system for longitudinal, multivariate clinical data , 2016, J. Biomed. Informatics.

[77]  Li Li,et al.  Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health Records , 2016, Scientific Reports.

[78]  Milad Moradi,et al.  Different approaches for identifying important concepts in probabilistic biomedical text summarization , 2016, Artif. Intell. Medicine.

[79]  Brian W. Pickering,et al.  User perception and experience of the introduction of a novel critical care patient viewer in the ICU setting , 2016, Int. J. Medical Informatics.

[80]  Marco Tulio Ribeiro,et al.  “Why Should I Trust You?”: Explaining the Predictions of Any Classifier , 2016, NAACL.

[81]  T. Salakoski,et al.  Comparison of automatic summarisation methods for clinical free text notes , 2016, Artif. Intell. Medicine.

[82]  William Speier,et al.  Evaluating topic model interpretability from a primary care physician perspective , 2016, Comput. Methods Programs Biomed..

[83]  J. Kern,et al.  Development of a Cancer Care Summary Through the Electronic Health Record. , 2016, Journal of oncology practice.

[84]  Kyungtae Kang,et al.  HeartSearcher: finds patients with similar arrhythmias based on heartbeat classification. , 2015, IET systems biology.

[85]  Jon D. Duke,et al.  Supporting Clinical Cognition: A Human-Centered Approach to a Novel ICU Information Visualization Dashboard , 2015, AMIA.

[86]  Hyejung Chang,et al.  Evaluation Framework for Telemedicine Using the Logical Framework Approach and a Fishbone Diagram , 2015, Healthcare informatics research.

[87]  Cristiana Larizza,et al.  JTSA: An open source framework for time series abstractions , 2015, Comput. Methods Programs Biomed..

[88]  Peter C. Laussen,et al.  Heuristic Evaluation of Data Integration and Visualization Software Used for Continuous Monitoring to Support Intensive Care: A Bedside NursesPerspective , 2015 .

[89]  Todd W. Rice,et al.  An Electronic Tool for the Evaluation and Treatment of Sepsis in the ICU: A Randomized Controlled Trial* , 2015, Critical care medicine.

[90]  Selina Y. F. Lee,et al.  Automatic summarization of risk factors preceding disease progression an insight-driven healthcare service case study on using medical records of diabetic patients , 2015, World Wide Web.

[91]  Philip R. O. Payne,et al.  EHR-based Visualization Tool: Adoption Rates, Satisfaction, and Patient Outcomes , 2015, EGEMS.

[92]  Garry Welch,et al.  Telehealth program for type 2 diabetes: usability, satisfaction, and clinical usefulness in an urban community health center. , 2015, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[93]  Noémie Elhadad,et al.  Automated methods for the summarization of electronic health records , 2015, J. Am. Medical Informatics Assoc..

[94]  Kristian Vlahovicek,et al.  Genomation: a Toolkit to Summarize, Annotate and Visualize Genomic Intervals , 2015, Bioinform..

[95]  J. Cimino,et al.  Clinicians′ evaluation of computer-assisted medication summarization of electronic medical records , 2015, Comput. Biol. Medicine.

[96]  Geraldine Fitzpatrick,et al.  Dashboards for improving patient care: Review of the literature , 2015, Int. J. Medical Informatics.

[97]  R. Arnaout,et al.  Ordo ab Chao: framework for an integrated disease report. , 2015, Archives of pathology & laboratory medicine.

[98]  Chengyi Zheng,et al.  Second Prize: A Natural Language Processing Program Effectively Extracts Key Pathologic Findings from Radical Prostatectomy Reports , 2014 .

[99]  Guilherme Del Fiol,et al.  Text summarization in the biomedical domain: A systematic review of recent research , 2014, J. Biomed. Informatics.

[100]  David K. Vawdrey,et al.  HARVEST, a longitudinal patient record summarizer , 2014, J. Am. Medical Informatics Assoc..

[101]  Vivian West,et al.  Innovative information visualization of electronic health record data: a systematic review , 2014, J. Am. Medical Informatics Assoc..

[102]  Frank Drews,et al.  Evaluation of a Configural Vital Signs Display for Intensive Care Unit Nurses , 2014, Hum. Factors.

[103]  B. Shneiderman,et al.  Temporal Event Sequence Simplification , 2013, IEEE Transactions on Visualization and Computer Graphics.

[104]  Nadim Anani,et al.  Integrated information visualization to support decision making for use of antibiotics in intensive care: design and usability evaluation , 2013, Informatics for health & social care.

[105]  Donia Scott,et al.  Data-to-text summarisation of patient records: Using computer-generated summaries to access patient histories☆ , 2013, Patient education and counseling.

[106]  Dean F Sittig,et al.  Health Care Transformation Through Collaboration on Open-Source Informatics Projects: Integrating a Medical Applications Platform, Research Data Repository, and Patient Summarization , 2013, Interactive journal of medical research.

[107]  F Cnossen,et al.  Visual metaphors on anaesthesia monitors do not improve anaesthetists' performance in the operating theatre. , 2013, British journal of anaesthesia.

[108]  Anne Miller,et al.  Evaluation of an integrated graphical display to promote acute change detection in ICU patients , 2012, Int. J. Medical Informatics.

[109]  Lena Mamykina,et al.  Clinical documentation: composition or synthesis? , 2012, J. Am. Medical Informatics Assoc..

[110]  Ehud Reiter,et al.  Automatic generation of natural language nursing shift summaries in neonatal intensive care: BT-Nurse , 2012, Artif. Intell. Medicine.

[111]  Tim Oates,et al.  Visualization of multivariate time-series data in a neonatal ICU , 2012, IBM J. Res. Dev..

[112]  Gaetano Borriello,et al.  Design of a phone-based clinical decision support system for resource-limited settings , 2012, ICTD.

[113]  Ricky K. Taira,et al.  Context-Based Electronic Health Record: Toward Patient Specific Healthcare , 2012, IEEE Transactions on Information Technology in Biomedicine.

[114]  Dean F. Sittig,et al.  Clinical Summarization Capabilities of Commercially-available and Internally-developed Electronic Health Records , 2012, Applied Clinical Informatics.

[115]  Kenneth Gersing,et al.  VisualDecisionLinc: A visual analytics approach for comparative effectiveness-based clinical decision support in psychiatry , 2012, J. Biomed. Informatics.

[116]  Adam Wright,et al.  Summarization of clinical information: A conceptual model , 2011, J. Biomed. Informatics.

[117]  Anthony Faiola,et al.  Advancing Critical Care in the ICU: A Human-Centered Biomedical Data Visualization Systems , 2011, HCI.

[118]  M. Görges,et al.  A Far-View Intensive Care Unit Monitoring Display Enables Faster Triage , 2011, Dimensions of critical care nursing : DCCN.

[119]  V. Herasevich,et al.  The effect of two different electronic health record user interfaces on intensive care provider task load, errors of cognition, and performance* , 2011, Critical care medicine.

[120]  Noémie Elhadad,et al.  Corpus-Based Problem Selection for EHR Note Summarization. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[121]  William Hsu,et al.  Tools for improving the characterization and visualization of changes in neuro-oncology patients. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[122]  James J. Masanz,et al.  Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications , 2010, J. Am. Medical Informatics Assoc..

[123]  David T. Bauer,et al.  The design and evaluation of a graphical display for laboratory data , 2010, J. Am. Medical Informatics Assoc..

[124]  Yuval Shahar,et al.  Intelligent visualization and exploration of time-oriented data of multiple patients , 2010, Artif. Intell. Medicine.

[125]  G. Hartvigsen,et al.  Secondary Use of EHR: Data Quality Issues and Informatics Opportunities , 2010, Summit on translational bioinformatics.

[126]  Gurpreet Singh Lehal,et al.  A Survey of Text Summarization Extractive Techniques , 2010 .

[127]  A McKinlay,et al.  Design Issues for Socially Intelligent User Interfaces , 2009, Methods of Information in Medicine.

[128]  Anne Miller,et al.  A Model-Integrated, Guideline-Driven, Clinical Decision-Support System , 2009, IEEE Software.

[129]  Anne Miller,et al.  The effects of clinical information presentation on physicians' and nurses' decision-making in ICUs. , 2009, Applied ergonomics.

[130]  R. Kaushal,et al.  Physicians’ Attitudes Towards Copy and Pasting in Electronic Note Writing , 2008, Journal of General Internal Medicine.

[131]  Albert Gatt,et al.  Summarising Complex ICU Data in Natural Language , 2008, AMIA.

[132]  Judith A. Effken,et al.  Clinical information displays to improve ICU outcomes , 2008, Int. J. Medical Informatics.

[133]  R. Koopman,et al.  Evaluating multivariate risk scores for clinical decision making. , 2008, Family medicine.

[134]  Robert G Loeb,et al.  A Simulation-Based Evaluation of a Graphic Cardiovascular Display , 2007, Anesthesia and analgesia.

[135]  Karen Spärck Jones Automatic summarising: The state of the art , 2007, Inf. Process. Manag..

[136]  Daniel M. Stein,et al.  Assessing Data Relevance For Automated Generation Of A Clinical Summary , 2007, AMIA.

[137]  Karin A. Thursky,et al.  User-centered design techniques for a computerised antibiotic decision support system in an intensive care unit , 2007, Int. J. Medical Informatics.

[138]  Ehud Reiter,et al.  Automatic Generation of Textual Summaries from Neonatal Intensive Care Data , 2007, AIME.

[139]  G. Hripcsak,et al.  Methodological Review: Temporal reasoning with medical data-A review with emphasis on medical natural language processing , 2007 .

[140]  Frank Drews,et al.  Research Paper: The Evaluation of a Pulmonary Display to Detect Adverse Respiratory Events Using High Resolution Human Simulator , 2006, J. Am. Medical Informatics Assoc..

[141]  Yuval Shahar,et al.  Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractions , 2006, Artif. Intell. Medicine.

[142]  Wei Li,et al.  Pachinko allocation: DAG-structured mixture models of topic correlations , 2006, ICML.

[143]  Anna S. Law,et al.  A Comparison of Graphical and Textual Presentations of Time Series Data to Support Medical Decision Making in the Neonatal Intensive Care Unit , 2005, Journal of Clinical Monitoring and Computing.

[144]  Panagiotis Stamatopoulos,et al.  Summarization from Medical Documents: A Survey , 2005, Artif. Intell. Medicine.

[145]  A. Ghosh,et al.  On the challenges of using evidence-based information: the role of clinical uncertainty. , 2004, The Journal of laboratory and clinical medicine.

[146]  Chin-Yew Lin,et al.  ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.

[147]  G. Walton,et al.  Information overload within the health care system: a literature review. , 2004, Health information and libraries journal.

[148]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[149]  Ben Shneiderman,et al.  LifeLines: using visualization to enhance navigation and analysis of patient records , 1998, AMIA.

[150]  Karen Spärck Jones Automatic summarising: factors and directions , 1998, ArXiv.

[151]  E. Tufte,et al.  Graphical summary of patient status , 1994, The Lancet.

[152]  Richard Alterman,et al.  Understanding and summarization , 1991, Artificial Intelligence Review.

[153]  Valerie Anderson,et al.  Producing Written Summaries: Task Demands, Cognitive Operations, and Implications for Instruction , 1986 .

[154]  Junwei Han,et al.  ChestXRayBERT: A Pretrained Language Model for Chest Radiology Report Summarization , 2023, IEEE Transactions on Multimedia.

[155]  Peter M. Full,et al.  Fine-tuning BERT Models for Summarizing German Radiology Findings , 2022, CLINICALNLP.

[156]  Yifan He,et al.  damo_nlp at MEDIQA 2021: Knowledge-based Preprocessing and Coverage-oriented Reranking for Medical Question Summarization , 2021, BIONLP.

[157]  Joy T. Wu,et al.  Semantic Expansion of Clinician Generated Data Preferences for Automatic Patient Data Summarization , 2021, AMIA.

[158]  Sahil Manchanda,et al.  Optum at MEDIQA 2021: Abstractive Summarization of Radiology Reports using simple BART Finetuning , 2021, BIONLP.

[159]  Yajuan Lyu,et al.  BDKG at MEDIQA 2021: System Report for the Radiology Report Summarization Task , 2021, BIONLP.

[160]  Liwen Xu,et al.  ChicHealth @ MEDIQA 2021: Exploring the limits of pre-trained seq2seq models for medical summarization , 2021, BIONLP.

[161]  Dina Demner-Fushman,et al.  Overview of the MEDIQA 2021 Shared Task on Summarization in the Medical Domain , 2021, BIONLP.

[162]  Ling Chai,et al.  paht_nlp @ MEDIQA 2021: Multi-grained Query Focused Multi-Answer Summarization , 2021, BIONLP.

[163]  Anu Mary Chacko,et al.  Extractive Summarization of EHR Notes , 2021 .

[164]  Jean-Benoit Delbrouck,et al.  QIAI at MEDIQA 2021: Multimodal Radiology Report Summarization , 2021, BIONLP.

[165]  Jennifer J. Liang,et al.  Reducing Physicians' Cognitive Load During Chart Review: A Problem-Oriented Summary of the Patient Electronic Record , 2021, AMIA.

[166]  Diwakar Mahajan,et al.  IBMResearch at MEDIQA 2021: Toward Improving Factual Correctness of Radiology Report Abstractive Summarization , 2021, BIONLP.

[167]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[168]  Jennifer J. Liang,et al.  A Novel System for Extractive Clinical Note Summarization using EHR Data , 2019, Proceedings of the 2nd Clinical Natural Language Processing Workshop.

[169]  Yuanyuan Yang,et al.  Three-Dimensional Visual Patient Based on Electronic Medical Diagnostic Records , 2018, IEEE Journal of Biomedical and Health Informatics.

[170]  Ke Xu,et al.  EventThread: Visual Summarization and Stage Analysis of Event Sequence Data , 2018, IEEE Transactions on Visualization and Computer Graphics.

[171]  Danny C. Sorensen,et al.  Finding representative electrocardiogram beat morphologies with CUR , 2018, J. Biomed. Informatics.

[172]  Tanveer F. Syeda-Mahmood,et al.  Generalized Extraction and Classification of Span-Level Clinical Phrases , 2018, AMIA.

[173]  Paolo Federico,et al.  Visual Analytics of Electronic Health Records with a Focus on Time , 2017 .

[174]  Margret Amatayakul,et al.  Developing Visual Thinking in the Electronic Health Record , 2017, MedInfo.

[175]  S. Chitrakala,et al.  A survey on extractive text summarization , 2017, 2017 International Conference on Computer, Communication and Signal Processing (ICCCSP).

[176]  David K. Vawdrey,et al.  Can Patient Record Summarization Support Quality Metric Abstraction? , 2016, AMIA.

[177]  Yuval Shahar,et al.  Generation of Natural-Language Textual Summaries from Longitudinal Clinical Records , 2015, MedInfo.

[178]  Yihan Deng,et al.  Visualizing Unstructured Patient Data for Assessing Diagnostic and Therapeutic History , 2014, MIE.

[179]  David C. Kale,et al.  Sim•TwentyFive: An Interactive Visualization System for Data-Driven Decision Support , 2012, AMIA.

[180]  A. McCoy,et al.  Clinical Summarization Capabilities of Commercially-available and Internally-developed Electronic Health Records , 2012, Applied Clinical Informatics.

[181]  Stéfan Jacques Darmoni,et al.  Towards iconic language for patient records, drug monographs, guidelines and medical search engines , 2010, MedInfo.

[182]  A Rappaport,et al.  Taking the problem oriented medical record forward. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.