williamliujl/CMExam
A Chinese National Medical Licensing Examination dataset and large languge model benchmarks
This project provides a comprehensive dataset of over 60,000 multiple-choice questions from the Chinese National Medical Licensing Examination. It's designed to help researchers and developers assess how well large language models can perform on complex medical knowledge tasks. You input Chinese medical exam questions, and it helps you evaluate how accurately different AI models can answer them, along with detailed annotations like disease groups and difficulty levels. This is for AI researchers and medical informatics professionals who are developing or benchmarking AI models for medical applications.
No commits in the last 6 months.
Use this if you are developing or evaluating AI models that need to demonstrate robust knowledge in the medical domain, specifically with Chinese medical content.
Not ideal if you need a dataset for assessing individual medical competence, patient diagnosis, or if your primary interest is in non-textual or multimodal medical questions (though a related multimodal dataset exists).
Stars
84
Forks
13
Language
Python
License
Apache-2.0
Category
Last pushed
Dec 02, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/williamliujl/CMExam"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
zjunlp/IEPile
[ACL 2024] IEPile: A Large-Scale Information Extraction Corpus
StefanHeng/ProgGen
Code for paper "ProgGen: Generating Named Entity Recognition Datasets Step-by-step with...
Yinghao-Li/GnO-IE
Code for "A Simple but Effective Approach to Improve Structured Language Model Output for...
MaheshJakkala/naamapadam-multilingual-ner
Benchmarking NER on Naamapadam across 7 Indic languages. EDA + model training for...
yaoyiran/BLI-Reading-List
A 2024 Reading List for Bilingual Lexicon Induction (BLI) / Word Translation. Frequently Updated.