bold84/cot_proxy
Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and
This tool helps teams and individuals better manage their interactions with Large Language Models, especially when using complex models like Qwen3 that have different modes for 'thinking' or 'normal' operation. It takes your application's standard LLM requests and intelligently modifies them—adding specific parameters, altering prompts, or cleaning up verbose model outputs—before sending them to the LLM. Marketers, researchers, or anyone using multiple applications with advanced LLMs will find this useful for standardizing interactions and getting cleaner, more relevant results.
No commits in the last 6 months.
Use this if your applications or workflows struggle to get consistent or optimal responses from advanced Large Language Models because they lack the ability to customize model parameters or manage complex model modes.
Not ideal if you primarily interact with LLMs directly through their native interfaces or if your applications already offer extensive parameter customization for your specific models.
Stars
51
Forks
5
Language
Python
License
MIT
Category
Last pushed
May 19, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/bold84/cot_proxy"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with...
vava-nessa/free-coding-models
Find, benchmark and install in CLI 158 FREE coding LLM models across 20 providers in real time
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with...