saran9991/llm-data-annotation
Use Large Language Models like OpenAI's GPT-3.5 for data annotation and model enhancement. This framework combines human expertise with LLMs, employs Iterative Active Learning for continuous improvement, and integrates CleanLab (Confident Learning) to ensure high-quality datasets and better model performance
This tool helps data scientists and ML engineers efficiently create high-quality, labeled datasets for machine learning. You upload your raw data, and it uses AI to suggest initial labels. You then review and correct any low-confidence or incorrect labels, resulting in a clean, human-verified dataset ready for model training.
No commits in the last 6 months.
Use this if you need to quickly and accurately label large datasets for training custom machine learning models, especially when precision and data quality are critical.
Not ideal if you already have perfectly clean, fully labeled datasets or if your project doesn't involve training new models on custom data.
Stars
40
Forks
4
Language
Python
License
MIT
Category
Last pushed
Sep 11, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/saran9991/llm-data-annotation"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
NVIDIA-NeMo/Curator
Scalable data pre processing and curation toolkit for LLMs
MigoXLab/dingo
Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
data-prep-kit/data-prep-kit
Open source project for data preparation for GenAI applications
TheDataStation/pneuma
LLM-Powered Data Discovery System for Tabular Data
cleanlab/cleanlab-studio
Client interface to Cleanlab Studio