daniel-furman/sft-demos
Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
This project provides pre-trained Large Language Models (LLMs) that excel at following short instructions and generating concise, structured answers. You input a question or prompt, and the model provides a direct, useful response, like solving a math problem or giving a recipe. This is ideal for a data scientist or machine learning engineer looking to integrate powerful, instruction-tuned AI into their applications.
No commits in the last 6 months.
Use this if you need a specialized LLM that can accurately follow instructions for generating text, solving problems, or extracting structured information.
Not ideal if you are looking for a general-purpose conversational AI or a tool to fine-tune models from scratch without prior machine learning expertise.
Stars
77
Forks
9
Language
Jupyter Notebook
License
Apache-2.0
Category
Last pushed
Oct 20, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/daniel-furman/sft-demos"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
agentscope-ai/Trinity-RFT
Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement...
OpenRLHF/OpenRLHF
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO &...
zjunlp/EasyEdit
[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
huggingface/alignment-handbook
Robust recipes to align language models with human and AI preferences
hyunwoongko/nanoRLHF
nanoRLHF: from-scratch journey into how LLMs and RLHF really work.