Resources
123 results for "evaluation"
Database
Credentialed Access
Clinical Time Series Datasets for Trajectory Flow Matching Evaluation: ICU Sepsis, ICU Cardiac Arrest, and ICU GIB Cohorts
This resource comprises three clinical time series datasets used in the paper Trajectory Flow Matching with Applications to Clinical Time Series Modeling to evaluate models for handling irregularly sampled data in critical care settings. The ICU Sep…
Database
Credentialed Access
MIMIC-IV-Ext Clinical Decision Making: A MIMIC-IV Derived Dataset for Evaluation of Large Language Models on the Task of Clinical Decision Making for Abdominal Pathologies
Clinical decision making is one of the most impactful parts of a physician's responsibilities and stands to benefit greatly from AI solutions such as large language models (LLMs). However, while many datasets exist to test the performance of AI mode…
Database
Credentialed Access
MIMIC-IV-Ext-DischargeBench: Dataset for Pre-Deployment Evaluation of LLM Discharge Educators through Patient Simulation
MIMIC-IV-Ext-DischargeBench is a derived dataset of 320 curated hospitalization cases (v1.0.0) built from MIMIC-IV (v3.1) and MIMIC-IV-Note (v2.2). Each case is a structured patient profile drawn from the discharge documentation of a single hospital…
Database
Restricted Access
Visual Question Answering evaluation dataset for MIMIC CXR
MIMIC CXR [1] is a large publicly available dataset of chest radiographs in DICOM format with free-text radiology reports. In addition, labels for the presence of 12 different chest-related pathologies, as well as of any support devices, and overall…
Database
Open Access
Human Balance Evaluation Database
The HBEDB contains force platform recordings from subjects undergoing stabilography tests. The subjects performed standing tasks under four different conditions: with their eyes opened or closed, while standing on a rigid or unstable surface. Each c…
Database
Credentialed Access
MedVAL-Bench: Expert-Annotated Medical Text Validation Benchmark
MedVAL-Bench is a dataset containing physician evaluations of errors in language model (LM)-generated medical text. The dataset spans 6 diverse medical text generation tasks and includes annotations from 12 physicians on clinically significant error…
Database
Credentialed Access
CORAL: expert-Curated medical Oncology Reports to Advance Language model inference
Both medical care and observational studies in oncology require a thorough understanding of a patient's disease progression and treatment history, often elaborately documented within clinical notes. As large language models (LLMs) are becoming more …
Challenge
Credentialed Access
Analysis of Clinical Text: Task 14 of SemEval 2015
SemEval (Semantic Evaluation) is an ongoing series of evaluations of computational semantic analysis systems, organized under the umbrella of SIGLEX, the Special Interest Group on the Lexicon of the Association for Computational Linguistics. This pr…
Database
Credentialed Access
PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactions
Doctor-patient consultations require multi-turn, context-aware communication tailored to diverse patient personas. Training or evaluating doctor LLMs in such settings requires realistic patient interaction systems. However, existing simulators often…
Database
Credentialed Access
MeDiSumQA: Patient-Oriented Question-Answer Generation from Discharge Letters
While increasing patients' access to medical documents improves medical care, this benefit is limited by varying health literacy levels and complex medical terminology. Large language models (LLMs) offer solutions by simplifying medical information.…