giuven95/chatgpt-failures
Failure archive for ChatGPT and similar models
This archive compiles real-world examples of how large language models (LLMs) like ChatGPT and New Bing can produce unexpected, incorrect, or problematic outputs. It gathers specific instances where these AI models fail in tasks ranging from basic arithmetic and factual recall to exhibiting unusual conversational behaviors. Anyone involved in evaluating, testing, or researching the practical limitations of current LLMs can use this resource to understand common failure modes.
597 stars. No commits in the last 6 months.
Use this if you need concrete examples of LLM failures for research, comparative analysis of different models, or to generate synthetic test data to improve AI robustness.
Not ideal if you are looking for a guide on how to fix these LLM issues yourself, or if you need a collection of success stories.
Stars
597
Forks
24
Language
Python
License
—
Category
Last pushed
Apr 07, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/giuven95/chatgpt-failures"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
k4l1sh/alexa-gpt
A tutorial on how to use ChatGPT in Alexa
rawandahmad698/PyChatGPT
⚡️ Python client for the ChatGPT API with, conversation tracking, proxy support and more.
Simatwa/WebChatGPT
Python SDK/API for ChatGPT Web-Version
toshiakit/MatGPT
MATLAB app to access ChatGPT API from OpenAI
minimaxir/simpleaichat
Python package for easily interfacing with chat apps, with robust features and minimal code complexity.