PropsAI/proxy
Props AI provides this open source proxy for Open AI that allows you to track token usage and send it into a kafka stream
This tool helps developers monitor and manage the costs associated with using OpenAI's API in their applications. It acts as an intermediary, taking requests meant for OpenAI, tracking the token usage for each request, and then forwarding that usage data into a Kafka stream. Developers building applications that integrate with OpenAI will use this to keep tabs on their API expenditures.
No commits in the last 6 months.
Use this if you are a developer building an application that uses OpenAI and you need a transparent way to track token usage and monitor API costs.
Not ideal if you are an end-user of an OpenAI-powered application and not involved in its development or infrastructure.
Stars
11
Forks
2
Language
Go
License
Apache-2.0
Category
Last pushed
Mar 12, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/PropsAI/proxy"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with...
vava-nessa/free-coding-models
Find, benchmark and install in CLI 158 FREE coding LLM models across 20 providers in real time
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with...