rb81/prompt-hacking-classifier
A flexible and portable solution that uses a single robust prompt and customized hyperparameters to classify user messages as either malicious or safe, helping to prevent jailbreaking and manipulation of chatbots and other LLM-based solutions.
This project helps protect your chatbots and large language model (LLM) applications from being manipulated or 'jailbroken' by malicious users. It takes incoming user messages and classifies them as either safe or malicious, outputting a simple 'true' or 'false'. Anyone managing or deploying LLM-powered solutions, such as product managers, AI ethics specialists, or operations engineers, would use this to enhance security.
No commits in the last 6 months.
Use this if you need a flexible and cost-effective way to prevent malicious users from bypassing your chatbot's intended behavior or extracting sensitive information.
Not ideal if you require a highly sophisticated, multi-layered security system beyond simple message classification, or if you need an actively maintained solution.
Stars
16
Forks
1
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Aug 08, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/rb81/prompt-hacking-classifier"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
protectai/llm-guard
The Security Toolkit for LLM Interactions
MaxMLang/pytector
Easy to use LLM Prompt Injection Detection / Detector Python Package with support for local...
utkusen/promptmap
a security scanner for custom LLM applications
agencyenterprise/PromptInject
PromptInject is a framework that assembles prompts in a modular fashion to provide a...
Resk-Security/Resk-LLM
Resk is a robust Python library designed to enhance security and manage context when...