qroa/QROA
QROA: A Black-Box Query-Response Optimization Attack on LLMs
QROA helps security researchers and AI safety engineers evaluate the robustness of Large Language Models (LLMs). It takes a malicious instruction and, through a series of interactions, identifies a 'trigger' that, when added to the instruction, makes the LLM produce harmful content. The output includes these optimized triggers and logs detailing the attack process and success.
No commits in the last 6 months.
Use this if you need to test how easily an LLM can be manipulated into generating harmful or unintended content without needing internal model access.
Not ideal if you are looking for a defensive tool to prevent LLMs from generating harmful content, as this tool is designed for offensive testing.
Stars
14
Forks
2
Language
Python
License
MIT
Category
Last pushed
May 23, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/qroa/QROA"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
GreyDGL/PentestGPT
Automated Penetration Testing Agentic Framework Powered by Large Language Models
berylliumsec/nebula
AI-powered penetration testing assistant for automating recon, note-taking, and vulnerability analysis.
ipa-lab/hackingBuddyGPT
Helping Ethical Hackers use LLMs in 50 Lines of Code or less..
MorDavid/BruteForceAI
Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks
mbrg/power-pwn
An offensive/defense security toolset for discovery, recon and ethical assessment of AI Agents