rbiswasfc/lmsys-arena
3rd Place Solution LMSYS - Chatbot Arena Human Preference Predictions
This project helps researchers and AI practitioners predict which of two chatbot responses a human would prefer. It takes conversational data with pairs of chatbot replies and outputs a prediction of the preferred response. This is useful for anyone evaluating and improving large language models based on human feedback.
No commits in the last 6 months.
Use this if you are a researcher or AI engineer focused on evaluating and ranking large language model outputs based on human preference.
Not ideal if you are looking for a pre-trained model for direct chatbot deployment or general-purpose text generation.
Stars
9
Forks
5
Language
Python
License
MIT
Category
Last pushed
Aug 18, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/rbiswasfc/lmsys-arena"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
kaushalpowar/talk_to_pdf
Talk to your pdf using OpenAI
Azmarie/GPT2-finetune
💠Fine-tune a Covid-19 Doctor-like chatbot with GPT2
grumpyp/NLP-quote-maker
A NLP driven script which will give you a quote according to the sentence you feed it. 💬 It...
team-watchdog/antilibrary
A little tool that lets you ask questions from your pdfs, epubs, text files and word documents.
harmindersinghnijjar/llama2-model-downloader
llama2-model-downloader is a Python script for effortless and flexible downloading of various...