joeljang/negated-prompts-for-llms
[NeurIPS 2022 Workshop] A Case Study with Negated Prompts using T0 (3B, 11B), InstructGPT (350M-175B), GPT-3 (350M - 175B) & OPT (125M - 175B) LMs
This project is for researchers and practitioners working with large language models (LLMs) who need to understand how well these models interpret negative statements or instructions. It helps you assess an LLM's comprehension of negation by providing tools to input prompts containing negated concepts and then analyze the model's responses to see if it correctly understands what *not* to do or say. Anyone evaluating LLM robustness or behavior for specific applications would find this useful.
No commits in the last 6 months.
Use this if you are a researcher or AI practitioner investigating the limitations and capabilities of large language models, particularly their ability to understand and respond correctly to negated instructions or information.
Not ideal if you are looking for a tool to simply generate or refine prompts for LLMs without deeply analyzing their nuanced understanding of negation.
Stars
24
Forks
1
Language
Python
License
—
Category
Last pushed
Sep 27, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/joeljang/negated-prompts-for-llms"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
BoundaryML/baml
The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go...
deanpeters/product-manager-prompts
A repository of Generative AI prompts for product managers using agents such as ChatGPT, Claude, & Gemini
eudk/awesome-ai-tools
🔴 VERY LARGE AI TOOL LIST! 🔴 Curated list of AI Tools - Updated 2026
jujumilk3/leaked-system-prompts
Collection of leaked system prompts
legeling/PromptHub
一款开源、纯本地 Prompt ,Skill 管理工具,帮助你高效管理、版本控制和复用 Prompt,并一键分发skill | An open-source, local-first AI...