user1342/Oversight
A Completely Modular LLM Reverse Engineering, Red Teaming, and Vulnerability Research Framework.
This framework helps security researchers and AI safety engineers evaluate Large Language Models (LLMs) for vulnerabilities. You can load an LLM (currently from HuggingFace) and then run various tests like prompt fuzzing or jailbreaking bypasses. The output is a detailed report showing the model's behavior and potential weaknesses, helping you understand and mitigate risks.
No commits in the last 6 months.
Use this if you need to systematically test LLMs for security vulnerabilities, unwanted behaviors, or to understand their internal workings for safety and robustness.
Not ideal if you are looking for a tool to develop or fine-tune LLMs, or if you don't have access to Nvidia CUDA for local execution.
Stars
54
Forks
2
Language
Python
License
GPL-3.0
Category
Last pushed
Nov 09, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/user1342/Oversight"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
GreyDGL/PentestGPT
Automated Penetration Testing Agentic Framework Powered by Large Language Models
berylliumsec/nebula
AI-powered penetration testing assistant for automating recon, note-taking, and vulnerability analysis.
ipa-lab/hackingBuddyGPT
Helping Ethical Hackers use LLMs in 50 Lines of Code or less..
MorDavid/BruteForceAI
Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks
mbrg/power-pwn
An offensive/defense security toolset for discovery, recon and ethical assessment of AI Agents