zjunlp/IEPile
[ACL 2024] IEPile: A Large-Scale Information Extraction Corpus
This project offers a massive, high-quality collection of Chinese and English text data specifically designed for training AI models to extract information. It takes raw text in various domains, like medical or financial, and helps create models that can automatically identify and pull out specific facts or entities based on predefined categories. This is primarily useful for AI researchers and developers who are building or improving large language models for information extraction tasks.
212 stars. No commits in the last 6 months.
Use this if you are developing AI models for automatically extracting specific data points from text and need a comprehensive, high-quality, and schema-based dataset for training and fine-tuning, especially for bilingual applications.
Not ideal if you are an end-user simply looking to apply an existing information extraction tool or if your task doesn't involve training new large language models.
Stars
212
Forks
19
Language
Python
License
—
Category
Last pushed
Jan 09, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/zjunlp/IEPile"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
williamliujl/CMExam
A Chinese National Medical Licensing Examination dataset and large languge model benchmarks
StefanHeng/ProgGen
Code for paper "ProgGen: Generating Named Entity Recognition Datasets Step-by-step with...
Yinghao-Li/GnO-IE
Code for "A Simple but Effective Approach to Improve Structured Language Model Output for...
MaheshJakkala/naamapadam-multilingual-ner
Benchmarking NER on Naamapadam across 7 Indic languages. EDA + model training for...
yaoyiran/BLI-Reading-List
A 2024 Reading List for Bilingual Lexicon Induction (BLI) / Word Translation. Frequently Updated.