BlackHC/player_of_jeopardy

ChatGPT can solve Jeopardy! clues really well!

21
/ 100
Experimental

This project helps evaluate how well AI models, specifically ChatGPT, can answer Jeopardy! clues. It takes a Jeopardy! clue as input and outputs the AI's answer, its confidence, and a self-evaluation of whether the answer is correct. Anyone interested in the capabilities of large language models for trivia or question-answering tasks, such as researchers or AI enthusiasts, would find this useful.

No commits in the last 6 months.

Use this if you want to understand the accuracy and calibration of large language models like ChatGPT when solving complex trivia questions.

Not ideal if you need a full Jeopardy! playing strategy that includes buzzing in and game theory, as this focuses only on the question-answering component.

AI evaluation trivia question answering language model performance game show analytics
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 5 / 25
Maturity 16 / 25
Community 0 / 25

How are scores calculated?

Stars

10

Forks

Language

Python

License

GPL-3.0

Last pushed

Mar 27, 2023

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/BlackHC/player_of_jeopardy"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.