aqstack/mimir
mimir is a drop-in proxy that caches LLM API responses using semantic similarity, reducing costs and latency for repeated or similar queries.
This tool helps developers reduce the costs and improve the speed of applications that use large language models (LLMs) like OpenAI. It acts as a go-between, taking in your LLM prompts and, if it finds a similar query it has seen before, returns a saved response instantly. If not, it forwards your request to the LLM and saves the new response. This is for software developers who are building or maintaining LLM-powered applications and want to optimize their API usage.
150 stars.
Use this if your application frequently sends similar or identical prompts to an LLM API and you want to save money and get faster responses.
Not ideal if your application's LLM prompts are always unique and never repeat, or if you need a persistent cache that isn't cleared when the proxy restarts.
Stars
150
Forks
93
Language
Go
License
MIT
Category
Last pushed
Dec 24, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/aqstack/mimir"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with...
vava-nessa/free-coding-models
Find, benchmark and install in CLI 158 FREE coding LLM models across 20 providers in real time
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with...