Node LLM Client SDKs LLM Tools

Official and community Node.js/TypeScript SDK wrappers for various LLM providers and APIs, enabling unified or provider-specific programmatic access to language models. Does NOT include frameworks for building LLM applications, testing tools, monitoring platforms, or higher-level abstractions like agents or RAG systems.

There are 133 node llm client sdks tools tracked. 10 score above 50 (established tier). The highest-rated is lmstudio-ai/lmstudio-js at 66/100 with 1,536 stars. 2 of the top 10 are actively maintained.

Get all 133 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=node-llm-client-sdks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	lmstudio-ai/lmstudio-js LM Studio TypeScript SDK	66	Established	1,536	TypeScript
2	lmstudio-ai/lms LM Studio CLI	62	Established	4,341	TypeScript
3	samestrin/llm-interface A simple NPM interface for seamlessly interacting with 36 Large Language...	59	Established	120	JavaScript
4	nbonamy/multi-llm-ts A Typescript library to use LLM providers APIs in a unified way.	57	Established	79	TypeScript
5	token-js/token.js Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.	56	Established	304	TypeScript
6	gregreindel/llm-exe A package that provides simplified base components to make building and...	55	Established	130	TypeScript
7	foundation-interface/graphologue Use LLM to stream diagrams, instead of tokens, in real-time! (UIST 2023 Paper)	55	Established	347	TypeScript
8	Flame-Code-VLM/Flame-Code-VLM Flame is an open-source multimodal AI system designed to translate UI design...	52	Established	556	Python
9	justyns/silverbullet-ai Plug for SilverBullet to integrate LLM functionality	51	Established	78	TypeScript
10	foyer-work/merlin-node Merlin SDK Provides A Unified API To Interact With 20+ LLM Models.	50	Established	42	TypeScript
11	CloudSilk/CloudSilk 云梭生产运营管理系统，作为工厂的“智能中枢”，负责精确调度与优化整个生产流程的各个环节。想象一下，一个工厂里有各种各样的机器和工人，他们需要按照一定的顺序...	49	Emerging	20	Go
12	McGill-NLP/weblinx WebLINX is a benchmark for building web navigation agents with...	49	Emerging	160	Python
13	xushengfeng/lime 大模型驱动的拼音输入法	48	Emerging	539	TypeScript
14	themaximalist/llm.js Universal LLM Interface	48	Emerging	134	HTML
15	deepinfra/deepinfra-node Official TypeScript wrapper for DeepInfra Inference API	46	Emerging	20	TypeScript
16	wearedevx/llm-together Plugin for LLM-CLI adding support for Together.AI hosting a large collection...	46	Emerging	18	Python
17	langtail/langtail-node Langtail TypeScript SDK	46	Emerging	12	TypeScript
18	meistrari/cursive ✦ The intuitive LLM framework	45	Emerging	113	TypeScript
19	zya/litellmjs JavaScript implementation of LiteLLM.	44	Emerging	146	TypeScript
20	pmndrs/prai JS Framework for building step-by-step LLM instructions	44	Emerging	76	TypeScript
21	piyook/llm-mock A local mock LLM server for early front end development work	43	Emerging	7	TypeScript
22	vlm-run/vlmrun-node-sdk Official Node.js SDK for VLM Run	43	Emerging	11	TypeScript
23	woniu9524/CodeAsk This is an LLM-based code reader.	43	Emerging	920	TypeScript
24	skovy/llm-markdown Demo rendering rich responses from LLMs	43	Emerging	163	TypeScript
25	rosssaunders/coincise Store for LLM friendly versions of Crypto Exchange APIs	43	Emerging	6	JavaScript
26	mokksy/ai-mocks AI-Mocks is a Kotlin-based mock server toolkit that brings service...	43	Emerging	39	Kotlin
27	Beledarian/Beledarians_LM_Studio_Toolbox This project is a plugin for LM Studio that provides a rich set of tools to...	42	Emerging	14	TypeScript
28	IdeaLeap/llm-ops 助力AIGC落地应用、高效开发llm workflow的低代码TS框架	42	Emerging	21	TypeScript
29	vertz-dev/vertz The TypeScript stack for LLMs	41	Emerging	19	TypeScript
30	vertesia/llumiverse Universal connector to LLMs for Node.js & Bun	41	Emerging	30	TypeScript
31	axiomhq/modeldb Free LLM API	41	Emerging	12	TypeScript
32	node-llm/node-llm The Backend-First AI SDK for Node.js. NodeLLM is an open-source...	40	Emerging	25	TypeScript
33	jrhizor/elelem Simple, opinionated, JSON-typed, and traced LLM framework for TypeScript.	40	Emerging	37	TypeScript
34	pezzolabs/UniLLM 🦄 Consume any LLM from any provider, using the OpenAI API	39	Emerging	28	TypeScript
35	0x6a69616e/node-vercel-llm-api JavaScript implementation of ading2210/vercel-llm-api.	38	Emerging	7	JavaScript
36	lunary-ai/abso TypeScript SDK to call 100+ LLM Providers in OpenAI format.	37	Emerging	55	TypeScript
37	laiso/askrepo Source code reading with LLM.	37	Emerging	223	TypeScript
38	zbigniewsobiecki/llmist Streaming-first multi-provider LLM client in TypeScript with home-made tool calling	37	Emerging	5	TypeScript
39	assistant-ui/modelpedia Open catalog of AI models across providers	37	Emerging	—	TypeScript
40	githubnext/llmorpheus LLM-based mutation testing	37	Emerging	14	TypeScript
41	sanand0/policyascode Generate dynamic learning memory from LLMs	36	Emerging	2	JavaScript
42	lamroger/waffie LLM API automated testing tool	36	Emerging	10	TypeScript
43	Siddhesh2377/Ai-Systems-New On-device AI SDK powering ToolNeuron — LLM chat & tool calling (llama.cpp),...	36	Emerging	7	C++
44	Mozilla-Ocho/formulaic-node The official Node library for Formulaic	35	Emerging	8	JavaScript
45	tensorchord/modelz-docs Modelz is a developer-first platform for prototyping and deploying machine...	35	Emerging	7	MDX
46	lockllm/lockllm-npm Official JavaScript/TypeScript SDK for LockLLM	35	Emerging	1	JavaScript
47	ant4g0nist/polar A LLDB plugin which brings LLMs to LLDB	35	Emerging	131	Python
48	r2d4/llm.ts Call any LLM with a single API. Zero dependencies.	35	Emerging	215	TypeScript
49	l1m-io/l1m The easiest way to get structured data from unstructured text or images...	34	Emerging	55	TypeScript
50	hilum-labs/local-llm Open source Node.js runtime for local LLM inference, on-device AI, and...	34	Emerging	1	TypeScript
51	llmops-build/llmops A pluggable LLMOps toolkit for TypeScript applications.	34	Emerging	44	TypeScript
52	humania-org/humanize LLM IS AS GOOD AS YOU ARE	34	Emerging	192	Shell
53	phospho-app/phosphojs The Node package for phospho, the LLM analytics platform	33	Emerging	5	TypeScript
54	monum/llm-prototypes Experimental projects with LLMs such as langchain agent chatbot; Google...	32	Emerging	5	JavaScript
55	hansjm10/vitest-llm-reporter The goal of this reporter is to provide rich context from test errors that...	32	Emerging	11	TypeScript
56	lalanikarim/tool-calling-llm-js A JS module to help convert any LangChain Chat Model into a Tool Calling LLM	31	Emerging	4	TypeScript
57	DataSQRL/acorn.js Turn GraphQL APIs into LLM Tools	30	Emerging	21	TypeScript
58	mandoline-ai/mandoline-node Official Node.js client for the Mandoline API	29	Experimental	2	TypeScript
59	pAIrprogio/synscript Libraries for immutable and chainable LLM compatible scripting	28	Experimental	6	TypeScript
60	snowheapllc/StruktX A configurable, typed AI framework with swappable LLM, classifier, handlers,...	28	Experimental	3	Python
61	lucasavila00/LmScript Controllable Language Model Interactions in TypeScript	28	Experimental	10	TypeScript
62	quolo-ai/quolo Quolo enables companies to easily build their own platforms that leverage...	27	Experimental	46	TypeScript
63	open-and-sustainable/alembica Open science package for LLM-powered semantic synthesis and precise...	27	Experimental	1	Go
64	sensoris/semcache-node Node SDK for the Semcache API	27	Experimental	1	JavaScript
65	charbelrami/tiny-llm-pipeline YAML DSL for LLM pipeline creation. Tiny. ESM. No deps.	27	Experimental	1	JavaScript
66	frost-beta/llm.js Node.js module providing inference APIs for large language models, with simple CLI.	26	Experimental	23	TypeScript
67	nakasyou/lmspecs Open-Source Language Model Database for comparison	25	Experimental	26	TypeScript
68	mazenemam19/work-impact-analysis-demo Automated impact analysis using LLM to help you understand and articulate your work.	24	Experimental	1	JavaScript
69	mybigday/node-qnn-llm Qualcomm lib Genie binding for Node.js	24	Experimental	1	C++
70	Yawanseh/guidescript GuideScript: Navigating Language Models, Simplified.	24	Experimental	56	TypeScript
71	detunjiSamuel/pocket-engineer USE LLM TO GENERATE APPLICATIONS	23	Experimental	3	JavaScript
72	wuvictor-95/ocr-llm An LLM-assisted multi-form API endpoint to convert image text into JSON	23	Experimental	3	Go
73	rodacato/SheLLM Your LLM subscriptions as a REST API	23	Experimental	2	JavaScript
74	greenido/multi-LLM-at-once Query few LLMs with one query and see who is the best 🙌🏾	23	Experimental	3	EJS
75	ProCoder1199X/EasiScriptX A high-performance domain-specific language (DSL) for AI/ML workflows.	23	Experimental	2	C++
76	0xcadams/hopfield 🐇 Typescript-first LLM framework with static type inference, testability,...	22	Experimental	19	TypeScript
77	kid1412621/beavarr LLM armed *arr stack watch experience	22	Experimental	—	TypeScript
78	polyphon-ai/polyphon-js JavaScript/TypeScript SDK for the Polyphon JSON-RPC API	22	Experimental	—	TypeScript
79	yashveerlabs/llm-stream Unified streaming interface for OpenAI, Anthropic, Ollama, and any...	22	Experimental	—	TypeScript
80	howlabs/openstream Minimal AI streaming library for TypeScript. OpenAI-first today, designed to...	22	Experimental	—	TypeScript
81	yashveerlabs/tool-registry Define LLM tools once, use them with OpenAI, Anthropic, and Gemini. Handles...	22	Experimental	—	TypeScript
82	JSLEEKR/mocklm LLM response mocking for tests — streaming SSE, tool_use blocks, fuzzy...	22	Experimental	—	TypeScript
83	azur-lane-ecgc/local-llm-parsing Repository for LLM data parsing using OpenCode	22	Experimental	—	TypeScript
84	Emi0084/dust-llm-capacitor Enable seamless integration of Dust LLM capabilities into Capacitor apps for...	22	Experimental	—	HTML
85	KillTrot/WindsurfPortable Make Windsurf Portable to have multiple, completely independent profiles on...	22	Experimental	—	C#
86	michael-tiller/LlamaBrain Open-source LLM governance framework for .NET. Deterministic validation,...	22	Experimental	—	C#
87	jeffdafoe/llm-memory-api LLM support for long-term memory, semantic search, and real-time communication.	22	Experimental	—	JavaScript
88	miles990/myelin Stop paying your LLM to make the same decision twice. Crystallize repeated...	22	Experimental	—	TypeScript
89	theblixguy/llm-mock-server A standalone mock LLM server for deterministic testing: OpenAI, Anthropic,...	22	Experimental	—	TypeScript
90	trchopan/proma Project Management Toolkit powered by LLMs	22	Experimental	—	TypeScript
91	Aswinsaipalakonda/llm-mock Drop-in mock clients for OpenAI and Anthropic SDKs. Test LLM-powered apps...	22	Experimental	—	TypeScript
92	log10-io/log10js JavaScript client library for managing your LLM data in one place	21	Experimental	11	JavaScript
93	andygeek/multillama-ts MultiLlama 🦙🦙🦙 is a TypeScript framework for using multiple LLMs...	21	Experimental	4	TypeScript
94	feedox/husher 🤫 husher - Encode text to be hidden from human eyes but visible to LLMs	21	Experimental	12	TypeScript
95	shba007/unai Unified AI Library. For Ollama, Gemini, OpenAI, Perplexity	21	Experimental	—	TypeScript
96	GeekBoySupreme/brunch Brunch is an alternative interface prototype to interact with Large Language Models	21	Experimental	7	JavaScript
97	multimindlab/multimind-sdk-js JavaScript for MultiMindSDK – bring advanced context transfer and multi-LLM...	21	Experimental	8	TypeScript
98	NickCorneau/Petrr-LLM LLM-based Personal Training Research aide	21	Experimental	1	TypeScript
99	space0blaster/dora-cli A CLI version for the deep search tool.	20	Experimental	7	JavaScript
100	hexxt-git/llm-steganography hide secrets in normal looking text using an LLM	20	Experimental	8	TypeScript
101	danieltyx/ModelMint We streamline the process of training customized AI models, distribution of...	20	Experimental	6	TypeScript
102	markomanninen/llm-experiments Large Language Models (OpenAI, Anthropic, Groq, Ollama) tested in NodeJS CLI...	20	Experimental	2	JavaScript
103	holasoymalva/typescript_mlm A specialized Micro Language Model engineered for TypeScript development	19	Experimental	2	—
104	lirantal/devrel-llm-tools This repository contains the code for experiments that demonstrate...	19	Experimental	4	JavaScript
105	pyronaur/zod-mind Type-safe interaction with LLMs like GPT	18	Experimental	1	TypeScript
106	Namchee/dupliket Triage issues and discussions efficiently by resolving duplicate references...	17	Experimental	1	TypeScript
107	nyatinte/typesafe-llm Tips for Using LLMs in a Type-safe	17	Experimental	1	TypeScript
108	eunomia-bpf/.github eunomia-bpf project template	17	Experimental	—	—
109	ali-m07/teams-llm-bot Enterprise-grade LLM integration for Microsoft Teams with Power Automate -...	17	Experimental	—	JavaScript
110	buildownai/tools Monorepository of LLM based t AI ools provided by BuildOwn.AI	17	Experimental	1	TypeScript
111	gl0bal01/llm-1minai LLM plugin providing access to AI models through 1min.ai API with web...	17	Experimental	—	Python
112	AaronFriel/fn-stream Create interactive, powerful AI applications with streaming, structured...	14	Experimental	23	TypeScript
113	ncmprbll/lookupper-self-hosted Self-hosted Lookupper	14	Experimental	—	Go
114	butterflyio/promptraise We help projects rank on top LLMs	14	Experimental	—	TypeScript
115	pali-mem/pali-js Typed JavaScript/TypeScript client and middleware for the Pali memory API.	14	Experimental	—	TypeScript
116	yockii/llm-mock-hub llm api mock hub	14	Experimental	—	TypeScript
117	hoipippeloi/llmngn.xyz $ llmngn_ is a context persistence plugin for OpenCode that remembers your...	14	Experimental	—	TypeScript
118	stefanwille/llm-tokens-playground A demo that makes LLM tokenization more tangible.	14	Experimental	—	TypeScript
119	the-crypt-keeper/Medusa-Bridge Join multiple local LLM API servers to the AI Horde	13	Experimental	4	JavaScript
120	twaslowski/grammr Reference toolkit for language-learning, aimed at systematic learners	13	Experimental	2	TypeScript
121	mysticfall/eldermind A framework designed for building LLM-driven mods for The Elder Scrolls: Skyrim.	13	Experimental	—	TypeScript
122	Vivekveer31/llm-cli-with-websearch Agentic LLM CLI built with Node.js featuring session memory and real-time...	13	Experimental	—	JavaScript
123	danpozmanter/mock-api Mock an arbitrary API using an OpenAPI spec	13	Experimental	—	Go
124	sanand0/assessor Assess documents for clauses using LLMs	13	Experimental	—	JavaScript
125	NexTech-Fusion/Rawen-toolbelt A playground of many approaches around AI espacially LLM by using different...	13	Experimental	—	TypeScript
126	lnmplang/lnmp-sdk-js TypeScript/JavaScript SDK for the LNMP (LLM Native Minimal Protocol):...	12	Experimental	1	JavaScript
127	rupeshs/ovllm_node_addon OpenVINO LLM Node.js C++ addon	12	Experimental	8	C++
128	merryvj/llm-daemons Prototype for writing with lil daemon buddies :)	12	Experimental	5	JavaScript
129	attilacsanyi/llm-playground Playing with different LLM capabilities in Nx workspace	12	Experimental	1	TypeScript
130	sheunglaili/llmfn Write Structured JavaScript / Typescript function in natural language	11	Experimental	—	TypeScript
131	longevity-genie/longevity-genie.github.io Static site of Longevity-genie project	11	Experimental	—	HTML
132	chenxingqiang/thinking-llm-protocols A TypeScript, CSS, JavaScript project focusing on Project Structure, 思维协议,...	11	Experimental	1	TypeScript
133	gregalexsmith/llm-tools Self hosted tools for LLMs	10	Experimental	2	TypeScript

Comparisons in this category

lmstudio-js and lms (66 vs 62) lmstudio-js and langtail-node (66 vs 46) multi-llm-ts and token.js (57 vs 56) llm-interface and llm.js (59 vs 48)