LLM Provider SDKs LLM Tools

Python SDKs and unified interfaces for interacting with multiple LLM providers and AI services. Includes official provider SDKs, multi-provider wrappers, and gateway libraries. Does NOT include framework-specific integrations (like LangChain), application-level tools, or non-SDK libraries.

There are 96 llm provider sdks tools tracked. 1 score above 70 (verified tier). The highest-rated is OpenCSGs/csghub-server at 73/100 with 1,414 stars. 2 of the top 10 are actively maintained.

Get all 96 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-provider-sdks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	OpenCSGs/csghub-server csghub-server is the backend server for CSGHub which helps user to manage...	73	Verified	1,414	Go
2	Whth/fabricatio Fabricatio is a Python library designed for building applications that...	65	Established	7	Python
3	OpenCSGs/csghub CSGHub is a brand-new open-source platform for managing LLMs, developed by...	64	Established	5,495	Vue
4	Haidra-Org/horde-sdk A python library to interact with AI-Horde's free generative AI APIs	60	Established	37	Python
5	Lightning-AI/litAI LLM router + minimal agent framework in one. Call any LLM API with OpenAI...	59	Established	47	Python
6	lzjever/lexilux Unified LLM API client library for Python. Simple API for Chat, Embedding,...	57	Established	35	Python
7	OpenRouterTeam/openrouter-examples Examples of integrating the OpenRouter API	56	Established	303	TypeScript
8	lmstudio-ai/lmstudio-python LM Studio Python SDK	56	Established	762	Python
9	Oaklight/ToolRegistry ToolRegistry: A Protocol-Agnostic Tool Management Library for Function-Calling LLMs	56	Established	48	Python
10	reVrost/go-openrouter Unofficial API SDK for openrouter.ai in go	55	Established	107	Go
11	oop7/OrChat A powerful, feature-rich command-line interface for interacting with AI...	52	Established	78	Python
12	AI21Labs/ai21-python AI21 Python SDK	52	Established	70	Python
13	Aleph-Alpha/intelligence-layer-sdk a unified framework for leveraging LLMs	48	Emerging	73	Python
14	sunholo-data/sunholo-py A python library to enable GenAI and LLMOps within Google Cloud Platform	46	Emerging	17	Python
15	vishwa-labs/vishwa-ml-sdk Python SDK for vishwa.ai	46	Emerging	21	Python
16	posit-dev/btw A complete toolkit for connecting R and LLMs	46	Emerging	113	R
17	Lifailon/openrouter-bot This project allows to launch your Telegram bot in a few minutes to...	45	Emerging	83	Go
18	OoriData/Toolio GenAI & agent toolkit for Apple Silicon Mac, implementing JSON...	45	Emerging	132	Python
19	MoonshotAI/kosong The LLM abstraction layer for modern AI agent applications.	44	Emerging	509	—
20	openlit/helm Helm Charts to deploy and manage OpenLIT in Kubernetes	43	Emerging	9	Smarty
21	just-llms/justllms Production-ready Python library for multi-provider LLM orchestration	43	Emerging	40	Python
22	zetane/zetaforgedev Open source AI platform for rapid development of advanced AI and AGI pipelines.	43	Emerging	219	Python
23	lhenault/simpleAI An easy way to host your own AI API and expose alternative models, while...	42	Emerging	331	Python
24	NiJingzhe/SimpleLLMFunc A simple and well-tailored LLM application framework that enables you to...	42	Emerging	76	Python
25	smartloop-ai/smartloop An agent to extract information and auto-tune from documents	41	Emerging	3	Shell
26	seanbrar/pollux Multimodal orchestration for LLM APIs. Source patterns, context caching, and...	41	Emerging	1	Python
27	Anilturaga/aiide Pragmatic framework to build LLM Copilots	41	Emerging	64	Python
28	llm-use/llm-use LLM orchestration toolkit for agent workflows: planner + workers +...	40	Emerging	34	Python
29	Bioto/glue-llm A high-level Python SDK for Large Language Models with automatic tool...	40	Emerging	1	Python
30	dropbox/aana_sdk Aana SDK is a powerful framework for building AI enabled multimodal applications.	40	Emerging	58	Python
31	unit-mesh/choco-builder ChocoBuilder (Chocolate Factory) is a cutting-edge LLM toolkit designed to...	40	Emerging	223	Kotlin
32	uripeled2/llm-client-sdk SDK for using LLM	39	Emerging	83	Python
33	xemantic/xemantic-ai-tool-schema AI/LLM tool use (function calling) JSON Schema generator - a Kotlin...	39	Emerging	50	Kotlin
34	wojtess/openrouter-api-go openrouter api integration in golang	39	Emerging	4	Go
35	speedshop/openrouter-us-only-cached-guardrail GitHub Action that updates an OpenRouter guardrail daily with US-only...	38	Emerging	21	Shell
36	BraveGroup/SheetCopilot We release a general framework for prompting LLMs to manipulate software in...	38	Emerging	163	Python
37	nikhil-robinson/openrouter_client A comprehensive OpenRouter API client library for ESP32 (ESP-IDF), enabling...	38	Emerging	29	C
38	11divyansh/OxyJen OxyJen is an open-source Java framework for orchestrating LLM workloads with...	38	Emerging	24	Java
39	modelmetry/modelmetry-sdk-python The Modelmetry Python SDK allows developers to easily integrate Modelmetry’s...	38	Emerging	1	Python
40	litechain-ai/litechain The zero-boilerplate LLM framework for humans.	37	Emerging	9	TypeScript
41	uaiso-serious/infra uaiso serious ai lab	37	Emerging	6	Shell
42	eduardolat/openroutergo Easy to use OpenRouter Golang SDK	36	Emerging	49	Go
43	casibase/go-openrouter OpenRouter Go SDK	36	Emerging	10	Go
44	mmeerrkkaa/openrouter-kit Powerful & flexible TypeScript SDK for the OpenRouter API. Streamlines...	36	Emerging	39	TypeScript
45	SynergOps/openrouter.ai Simple terminal app to use Openrouter.ai with your personal API keys	35	Emerging	9	Shell
46	routeplex/routeplex-node Official Node.js SDK for RoutePlex — multi-model AI gateway	34	Emerging	1	JavaScript
47	anthalehq/anthale-python Anthale's official Python SDK	34	Emerging	1	Python
48	Tetramatrix/lemonade-python-sdk A production-grade Python SDK for the Lemonade LLM backend. Featuring...	33	Emerging	4	Python
49	instill-ai/helm-charts ⎈ The Helm charts of Instill AI	32	Emerging	2	—
50	dingo-actual/openrouter-python-client An unofficial Python client for OpenRouter	32	Emerging	4	Python
51	JonahWhaler/llm-agent-toolkit LLM AgeToolkit provides minimal, modular interfaces for core components in...	32	Emerging	3	Python
52	Cycls/cycls The open-source SDK for distributing AI agents.	32	Emerging	22	Python
53	slava-vishnyakov/chatlet Python wrapper for the OpenRouter API	31	Emerging	6	Python
54	nex-agi/weaver Python SDK for Weaver.	31	Emerging	13	Python
55	JavaAIDev/llm-agent-builder LLM Agent Builder	31	Emerging	2	Kotlin
56	hanzoai/python-sdk Hanzo Python SDK — LLM gateway, agents, and AI cloud	31	Emerging	2	Python
57	jvrck/openrouterlist OpenRouter model information	30	Emerging	7	HTML
58	lollipopkit/or-models-compare A static web page showcasing OpenRouter models, automatically updated daily,...	29	Experimental	6	HTML
59	hltcoe/sandle Run a large language modeling SANDbox in your Local Environment	29	Experimental	7	Python
60	tracehubpm/jivan Experimental neural static analyzer for Java programs, based on ML and LLM	28	Experimental	2	—
61	hra42/openrouter-go A zero-dependency Go client library for the OpenRouter API with full...	27	Experimental	2	Go
62	GodChatCapital/zeus-library Zeus - a revolutionary solution for storing, managing, and securing your...	27	Experimental	2	JavaScript
63	jonschlinkert/model-exchange-grammar-protocol The Model Context Grammar Protocol defines a simple, extensible, and...	27	Experimental	7	—
64	DedInc/oprouter4j A Java client for the OpenRouter API. This library handles the HTTP layer,...	26	Experimental	1	Java
65	lofye/foundry-framework Foundry is a modern LLM-First Web Framework written in PHP 8.4. It was...	25	Experimental	1	PHP
66	agentvoiceresponse/avr-llm-openrouter This repository showcases the integration between Agent Voice Response and...	25	Experimental	—	JavaScript
67	johnbrodowski/AgnosticToolBuilder A provider-agnostic tool builder for AI/LLM function calling that lets you...	24	Experimental	1	C#
68	janvanwassenhove/scrum Scrum programming language	24	Experimental	2	Java
69	Mattbusel/llm-agent Zero-dependency single-header C++ tool-calling agent loop. Define tools as...	23	Experimental	2	C++
70	gsavla6-hue/java-llm-agent Autonomous LLM agent implementation in Java with tool use, planning and...	22	Experimental	—	Java
71	Veerxps/1c-llm-requests 🚀 Streamline LLM integration with 1C databases using this simple HTTP...	22	Experimental	—	1C Enterprise
72	SwastikAI/swastikai-python-sdk Official Python SDK for SwastikAI	21	Experimental	11	Python
73	eykrehbein/foundry A framework-agnostic toolset to create and use Functions in LLM-based apps.	21	Experimental	23	TypeScript
74	DedInc/oprouter OpRouter is an asynchronous Python client for the OpenRouter API. It handles...	21	Experimental	—	Python
75	bluefermion/n8n-nodes-demeterics n8n community node for Demeterics LLM Gateway - access OpenAI, Anthropic,...	21	Experimental	—	TypeScript
76	AndrewBz512/llm-configs Production-ready LLM configuration templates for SecOps automation,...	21	Experimental	—	—
77	bsdfbsdfgsfbs/oprouter 🤖 Build AI-powered apps easily with OpRouter, a simple Python library for...	21	Experimental	—	Python
78	TimHanewich/TimHanewich.Foundry A lightweight .NET library for interfacing with LLM deployments in Microsoft...	21	Experimental	—	C#
79	LuchoBazz/PyLLM-Facade A modular Python library providing a unified interface for multiple LLM...	20	Experimental	1	Python
80	jonaylor89/SaintJohn Minimal Android Launcher with built in LLM	19	Experimental	1	Kotlin
81	liyedanpdx/llm-python-patterns Classic design patterns for LLM applications in Python. Interactive...	18	Experimental	1	Jupyter Notebook
82	LLMPages/onesdk OneSDK is a Python library that provides a unified interface for interacting...	18	Experimental	2	Python
83	JavaAIDev/common-llm-tools LLM Agent Builder Tools	17	Experimental	1	Java
84	BodhiHu/kubeflow-lab Kubeflow lab for running cloudy AI ops /w ease.	17	Experimental	1	Jupyter Notebook
85	skobkin/openrouter-costs-tray See OpenRouter cost stats in your tray.	17	Experimental	—	Go
86	lastime1650/EDR_backend LLM AI EDR 백엔드	17	Experimental	—	YARA
87	ioniccommerce/ionic_sdk_python Ionic Commerce Python SDK	17	Experimental	1	Python
88	EmreMutlu99/Ollama-Agent-Kit Llama Agent Kit is an open-source Node.js toolkit for building...	14	Experimental	11	JavaScript
89	MasterKun94/rpc-llm-bridge-java A Java framework that converts RPC services into tools for LLMs, enabling...	13	Experimental	—	Java
90	mantissa-lab/PyGitForge A universal, AI-friendly Python client for Git forges (GitHub, GitLab,...	13	Experimental	—	Python
91	bkovacki/gopenrouter The GOpenRouter library provides convenient access to the OpenRouter REST...	13	Experimental	—	Go
92	iatsiuk/orx-cli CLI tool for sending prompts to multiple LLM models via OpenRouter API in parallel	13	Experimental	—	Go
93	velocitatem/fabric.el A Spacemacs package integrates with Fabric AI to enhance workflows with...	12	Experimental	7	Emacs Lisp
94	aayes89/jLLM Un modelo de lenguaje para Java	11	Experimental	—	Java
95	VedanthB/ort OpenRouter Tool — access 344+ AI models from the terminal. One CLI for...	11	Experimental	—	Go
96	ivycheck/ivycheck-python-sdk Python SDK for IvyCheck	10	Experimental	2	Jupyter Notebook

Comparisons in this category

csghub-server and csghub (73 vs 64)