uni-medical/GMAI-MMBench
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI.
This project provides a comprehensive benchmark for evaluating the performance of multimodal AI models in a medical context. It takes various medical images and clinical data as input and assesses how accurately AI models can answer questions related to diagnoses, prognoses, and treatments. Healthcare AI researchers and developers can use this to rigorously test and compare their AI systems.
No commits in the last 6 months.
Use this if you are developing or researching medical AI models and need a standardized, comprehensive way to evaluate their ability to interpret diverse medical images and answer clinical questions.
Not ideal if you are an end-user clinician seeking a ready-to-use diagnostic tool, as this is a benchmark for evaluating AI models, not a clinical application.
Stars
82
Forks
2
Language
—
License
Apache-2.0
Category
Last pushed
Dec 17, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/uni-medical/GMAI-MMBench"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
MMMU-Benchmark/MMMU
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal...
pat-jj/DeepRetrieval
[COLM’25] DeepRetrieval — 🔥 Training Search Agent by RLVR with Retrieval Outcome
lupantech/MathVista
MathVista: data, code, and evaluation for Mathematical Reasoning in Visual Contexts
x66ccff/liveideabench
[𝐍𝐚𝐭𝐮𝐫𝐞 𝐂𝐨𝐦𝐦𝐮𝐧𝐢𝐜𝐚𝐭𝐢𝐨𝐧𝐬] 🤖💡 LiveIdeaBench: Evaluating LLMs' Scientific Creativity and Idea...
ise-uiuc/magicoder
[ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct