KadirArslan/Mithra-Scanner
Mithra Scanner is an interactive API testing tool for prompt injection, refusal detection, and LLM security benchmarking. It supports YAML-based rule definitions, custom refusal lists, REST API integration, and provides detailed CLI output for security testing of language model endpoints.
This tool helps security engineers and AI product managers test their large language model (LLM) APIs for vulnerabilities like prompt injection and unwanted content generation. It takes a list of predefined attack prompts and refusal phrases, feeds them into your LLM endpoint, and reports which attacks succeeded or were properly refused. This allows you to benchmark your LLM's security against known threats.
No commits in the last 6 months.
Use this if you need to systematically test your LLM's security and ensure it doesn't respond to malicious prompts or generate undesirable content.
Not ideal if you are looking for a general-purpose LLM evaluation framework or a tool to analyze LLM performance on standard benchmarks.
Stars
52
Forks
—
Language
Python
License
—
Category
Last pushed
Sep 09, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/KadirArslan/Mithra-Scanner"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
GreyDGL/PentestGPT
Automated Penetration Testing Agentic Framework Powered by Large Language Models
berylliumsec/nebula
AI-powered penetration testing assistant for automating recon, note-taking, and vulnerability analysis.
ipa-lab/hackingBuddyGPT
Helping Ethical Hackers use LLMs in 50 Lines of Code or less..
MorDavid/BruteForceAI
Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks
mbrg/power-pwn
An offensive/defense security toolset for discovery, recon and ethical assessment of AI Agents