glgh/awesome-llm-human-preference-datasets

A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.

37
/ 100
Emerging

This is a curated collection of real-world conversational data, including questions, model answers, and human ratings on preference, helpfulness, and harmlessness. It provides essential inputs for improving how large language models (LLMs) interact with users. Data scientists, machine learning engineers, and AI researchers working on advanced conversational AI would use this.

387 stars. No commits in the last 6 months.

Use this if you need high-quality human feedback data to refine and evaluate large language models for better performance in real-world applications.

Not ideal if you are looking for general text corpora or natural language processing datasets without specific human preference annotations.

conversational-ai large-language-models machine-learning-engineering model-evaluation human-feedback
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 11 / 25

How are scores calculated?

Stars

387

Forks

18

Language

License

MIT

Last pushed

Oct 04, 2023

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/glgh/awesome-llm-human-preference-datasets"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.