Resources
16 results for "clinical llm"
Database
Contributor Review
ER-REASON: A Benchmark Dataset for LLM-Based Clinical Reasoning in the Emergency Room
The ER-Reason dataset is a benchmark designed to evaluate LLM-based clinical reasoning and decision-making in the emergency room (ER), a high-stakes setting where clinicians make rapid, consequential decisions across diverse patient presentations an…
Database
Credentialed Access
EHRNoteQA: An LLM Benchmark for Real-World Clinical Practice Using Discharge Summaries
Discharge summaries in Electronic Health Records (EHRs) are crucial for clinical decision-making, but their length and complexity make information extraction challenging, especially when dealing with accumulated summaries across multiple patient adm…
Database
Credentialed Access
MIMIC-III-Ext-VeriFact-BHC: Labeled Propositions From Brief Hospital Course Summaries for Long-form Clinical Text Evaluation
The VeriFact-BHC dataset is designed to verify the factuality of long-form text written about a patient against their own electronic health record. There is increasing interest in using large language models (LLMs) to generate clinical text in patie…
natural language processing
clinical informatics
formal logic
clinical notes
chart review
text embedding
brief hospital course
long-form text
logical atomism
retrieval-augmented generation
text reranking
clinical medicine
atomic claim
fact verification
hybrid retrieval
llm-as-a-judge
llm evaluation
electronic health records
large language models
artificial intelligence
Database
Credentialed Access
MIMIC-III-Ext-SBDH: An annotated social and behavioral determinants of health dataset
This study presents MIMIC-III-Ext-SBDH, a manually reviewed and consolidated annotation dataset of social and behavioral determinants of health (SBDH) derived from clinical notes in the MIMIC-III database. We previously developed SBDH-Reader, a larg…
Database
Credentialed Access
MIMIC-Ext-SynNotes: Large-Scale Synthetic Clinical Notes via Rephrasing MIMIC-III/IV with LLMs
MIMIC-III and MIMIC-IV are foundational resources for clinical NLP, but their scale is modest relative to the data volumes needed to train language models. Building on recent advances in synthetic data generation through LLM-based rephrasing, we con…
Database
Credentialed Access
MIMIC-III-Ext-MIMIC-Patient: Structured Per-Patient JSON Records for Clinical Question Answering
This project provides MIMIC-Patient, a structured, per-patient representation of the MIMIC-III database designed for large language model (LLM)–based clinical question answering. For each of 500 admissions, we reconstruct the patient’s episode into …
Database
Credentialed Access
MIMIC-III-Ext-Notes
Unstructured clinical documentation, such as progress notes, contains rich contextual information critical for clinical decision-making but remains underutilized in computational research due to the limited availability of annotated datasets. The MI…
Database
Credentialed Access
Medical-CXR-VQA dataset: A Large-Scale LLM-Enhanced Medical Dataset for Visual Question Answering on Chest X-Ray Images
Medical Visual Question Answering (VQA) is an important task in medical multi-modal Large Language Models (LLMs), aiming to answer clinically relevant questions regarding input medical images. This technique has the potential to improve the efficien…
Database
Credentialed Access
MIMIC-CXR-Ext-ReRef: A Radiologist-Validated Dataset of MIMIC-CXR Report Pairs Following Different Reporting Practices
Radiologists follow heterogeneous reporting practices: two radiologists examining the same image and identifying the same clinical findings might nevertheless compose superficially distinct reports, varying in terminology, shorthand, formatting, and…
Model
Credentialed Access
Me-LLaMA: Foundation Large Language Models for Medical Applications
Recent advancements in large language models (LLMs) such as ChatGPT and LLaMA have hinted at their potential to revolutionize medical applications, yet their application in clinical settings often reveals limitations due to a lack of specialized tra…