Browser Local LLM LLM Tools

Tools and frameworks for running large language models entirely in web browsers without cloud infrastructure, using technologies like WebGPU, WebAssembly, and transformers.js. Does NOT include cloud-based LLM APIs, desktop applications, or server-side inference engines.

There are 92 browser local llm tools tracked. 1 score above 70 (verified tier). The highest-rated is mlc-ai/web-llm at 73/100 with 17,562 stars. 2 of the top 10 are actively maintained.

Get all 92 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=browser-local-llm&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	mlc-ai/web-llm High-performance In-browser LLM Inference Engine	73	Verified	17,562	TypeScript
2	e2b-dev/desktop E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment...	65	Established	1,278	MDX
3	geekjr/quickai QuickAI is a Python library that makes it extremely easy to experiment with...	59	Established	162	Python
4	Azure-Samples/llama-index-javascript This sample shows how to quickly get started with LlamaIndex.ai on Azure 🚀	56	Established	72	TypeScript
5	AkagawaTsurunaki/zerolan-core ZerolanCore integrates many open-source, locally deployable AI models, and...	54	Established	86	Python
6	ParisNeo/lollms An all in one AI solution compatible with any known AI service on the planet	51	Established	53	Vue
7	qusaismael/localllm Your LLM, Your Data , Your GUI.	50	Established	93	JavaScript
8	chrisrobison/textweb A text-grid web renderer for AI agents — see the web without screenshots	50	Established	76	JavaScript
9	mindolph/Mindolph Mindolph is an open source personal knowledge management software with...	50	Established	191	Java
10	mrdjohnson/llm-x LLMX; Easiest 3rd party Local LLM UI for the web!	49	Emerging	292	TypeScript
11	AmyangXYZ/PoPo Pose and animate MMD model with LLM and MPL code	48	Emerging	251	TypeScript
12	xencon/aixcl Local first development platform with LLM integration.	48	Emerging	12	Shell
13	wsargent/groundedllm AI agent grounded with search and extract tools to reduce hallucination.	47	Emerging	78	Python
14	heripo-lab/llm-newsletter-kit-core An extensible framework to automate your entire newsletter workflow. Handles...	47	Emerging	41	TypeScript
15	rahuldshetty/llm.js Run Large-Language Models (LLMs) 🚀 directly in your browser!	46	Emerging	228	JavaScript
16	callawaycloud/llm-apex-agents Run Large Language Model "Agents" in Salesforce apex	44	Emerging	55	Apex
17	Dicklesworthstone/useful_coding_guides_for_llms Detailed Next.js best-practice guides designed for humans and LLM coding...	43	Emerging	19	—
18	GeneploreAI/gibberifier Stun LLMs with random Unicode characters	40	Emerging	116	HTML
19	qiuxchao/yapi-ai-mock 使用 LLM，将 YAPI 接口文档生成为本地的 Mock 文件。	40	Emerging	3	TypeScript
20	EmbraceAGI/LocalAGI LocalAGI：Locally run AGI powered by LLaMA, ChatGLM and more. ｜基于 ChatGLM,...	40	Emerging	82	Python
21	typesense/showcase-natural-language-search-cars-genkit Use LLMs with Typesense to power Natural Language Search	39	Emerging	14	TypeScript
22	hilum-labs/local-llm-rn React Native SDK for local LLM inference and on-device AI on iOS and Android.	39	Emerging	1	TypeScript
23	r2d4/react-llm Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU....	38	Emerging	702	TypeScript
24	scottstirling/pi2llm LLM AI integration for PixInsight	37	Emerging	11	JavaScript
25	lbdudc/dsl-xpert This tool provides a web interface to define domain-specific languages and...	37	Emerging	16	JavaScript
26	Aditya060806/WebScope Stop sending screenshots to vision models. WebScope renders websites into...	37	Emerging	1	JavaScript
27	nadchif/in-browser-llm-inference Download and run local LLMs within your browser	37	Emerging	24	JavaScript
28	thejoltjoker/lightroom-llama A lightroom plugin for interacting with ollama.	36	Emerging	9	Lua
29	sedwards2009/llm-multitool Web UI for working with large language models	35	Emerging	38	Go
30	danielroe/carpenter LLM-powered automations for triaging Nuxt issues	35	Emerging	76	TypeScript
31	medialab/ecologies-of-llm-practices Official website of EL2MP Medialab's project	35	Emerging	1	Svelte
32	ugo-emekauwa/private-ai-setup-dream-guide The Private AI Setup Dream Guide for Demos automates the installation of the...	34	Emerging	7	Shell
33	Antonoko/playdate-puppy-llm A LLM interface that pays homage to rabbit r1 on Playdate.	33	Emerging	56	Lua
34	akutishevsky/local-llm-playground LWC for running LLMs Locally in Salesforce Experience Cloud using picoLLM...	33	Emerging	4	JavaScript
35	tianrking/LEIA LEIA (LLM-driven Embedded Interface Architecture)	32	Emerging	3	JavaScript
36	hoangnv170752/StudyNest Local PC app for everyone to use LLM locally 🫡	32	Emerging	22	Rust
37	dvoaviarison/ring-doorbell-notifier Simple, AI powered, nodejs app that will let you skip the expensive...	32	Emerging	1	JavaScript
38	radames/LLM-automator Create keyboard shortcuts for an LLM using OpenAI GPT, Ollama, HuggingFace...	31	Emerging	154	Python
39	yWorks/yfiles-graph-for-create-llama An interactive integration of yFiles for HTML with LlamaIndex to visualize...	31	Emerging	50	TypeScript
40	akutishevsky/salesforce-local-llm-assistant LWC that runs LLMs locally on your computer and uses Salesforce records for context.	30	Emerging	13	Apex
41	YoungLee-coder/Captra 基于LLM的验证码识别API服务	30	Emerging	5	TypeScript
42	SushieA1/LLM-js LM Studio & Ollama API Wrapper	29	Experimental	1	JavaScript
43	hannes-sistemica/browser-llm-webgpu Proof of concept for a reasoning model that runs locally in your browser...	29	Experimental	18	HTML
44	Singularities-AI/singularities-ai User-friendly LLM interface, self-hosted, offline, and privacy-first.	29	Experimental	6	Vue
45	GenR8ive/VizuLLM Schema-Driven Rendering Engine for LLM-Generated Documents	29	Experimental	6	TypeScript
46	jbilcke-hf/template-node-llama-express A minimalist Docker project to get started with Node, llama-node and...	28	Experimental	8	TypeScript
47	matthieu-perso/native Open source & private LLM apps on your desktop	28	Experimental	10	TypeScript
48	oidahdsah0/Rimworld_AI_Framework A revolutionary AI-powered framework for RimWorld that brings Large...	28	Experimental	12	C#
49	RandomGamingDev/local-on-device-llm-browser-extension-example An example & tutorial for learning how to get a local LLM running on the...	25	Experimental	2	JavaScript
50	final-kk/kandle A JavaScript Native PyTorch-aligned Machine Learning Framework, built from...	25	Experimental	6	TypeScript
51	AnotiaWang/siliconcloud-stats 更详细的 SiliconCloud 统计分析	25	Experimental	14	Vue
52	monatis/llm-api Web API and websocket for Large Language Models in C++	23	Experimental	4	C++
53	devtobi/aigelb Evaluation of LLMs and browser implementation for browsing the Web in Easy...	22	Experimental	—	Vue
54	KnightLordHUN/private-ai-setup-dream-guide 🤖 Automate local private AI setups for demos, showcasing models for diverse...	22	Experimental	—	Shell
55	yashveerlabs/vite-plugin-llm Vite plugin that uses your local LLM to generate mock data and scaffold...	22	Experimental	—	TypeScript
56	StreamnDad/reeln-plugin-openai reeln-cli plugin for OpenAI-powered LLM integration — livestream metadata,...	22	Experimental	—	Python
57	ameshkov/llm-ads-demo Demo project that shows how LLM ads are implemented	22	Experimental	6	JavaScript
58	telunyang/nodejs_ai_basics 教材: 透過 Node.js 來體驗基礎的 AI 模型	22	Experimental	9	JavaScript
59	AieatAssam/daily-unsupervised-llm-game A repository containing unsupervised automation to generate a daily web-based game.	22	Experimental	—	HTML
60	knoopx/llm-workbench Unleash the power of FOSS language models on your local machine	21	Experimental	32	TypeScript
61	brainsaysno/metaprog An experimental and versatile library for exploring LLM-assisted meta-programming.	21	Experimental	13	TypeScript
62	monatis/open-tasks Let LLMs schedule tasks for you and itself	20	Experimental	11	Python
63	tomcasaburi/subplebbit-spam-test AI-powered captcha solving research project for Plebbit	19	Experimental	2	JavaScript
64	sanand0/llmdemos A collection of LLM demos with business use-cases	19	Experimental	—	HTML
65	didinj/nodejs-llm-ai-app-example From Zero to AI App: Build and Deploy Your First LLM Project	17	Experimental	—	JavaScript
66	whatrocks/oldpal Old Pal is an LLM-powered tool for exploring your local town's meeting minutes	17	Experimental	1	TypeScript
67	whobot-ai/llms.txt WhoBot AI (呼波特) llms.txt — Machine-readable company profile for LLM...	16	Experimental	2	—
68	bhataparnak/LLM-Fine-Tuning-Dashboard1 Forezy.ai LLM fine Tuning Dashboard is built using Next.Js, Tailwind CSS. It...	16	Experimental	3	JavaScript
69	callbacked/psvita-llm A small storytelling LLM running on the PS Vita	16	Experimental	27	C
70	knuthp/tools Misc simple HTML and python scripts. LLM generated	14	Experimental	—	HTML
71	linG5821/ollama-top-llm a model ranking about ollama	14	Experimental	—	TypeScript
72	ekelhala/llamactl-console A web UI for llamactl built with Go and React	14	Experimental	—	TypeScript
73	Asereardscon3/LLM-Fine-Tuning-Dashboard A comprehensive React/TypeScript dashboard for monitoring and managing...	14	Experimental	—	TypeScript
74	pccr10001/llm-captcha LLMs still need us to resolve CAPTCHAs.	14	Experimental	1	Go
75	nerding-io/memgame-webai A simple memory game using an LLM and ability to upload markdown notes.	13	Experimental	3	JavaScript
76	LLMist/Multi.LLM.ist MultiLLM Official Site	13	Experimental	—	JavaScript
77	gizmo-ds/chatjs-mod Access large language models from KubeJS using an OpenAI-compatible API.	13	Experimental	—	Java
78	walsh441/LMD 🧠 Generate dynamic narratives with LMD, a framework for episodic memory that...	13	Experimental	—	C#
79	farazzbhn/ManagedLanguageModel LLM .NET managed client for Large Language Model services ( OpenAI, Groq,...	13	Experimental	—	C#
80	old-zet/rgpd-friendly-llm Launch a small enough LLM locally, infer it via CPU with llama.cpp, and...	13	Experimental	—	JavaScript
81	ngoodman3209/Llama3.1ExperimentOpenSource AI experiment using Meta Llama 3.1 with Ollama, LangChain.js, and Fastify in...	13	Experimental	—	TypeScript
82	SBanditaDas/ML-Large-Model-Suites-On-LLM-LCM-LAM A high-performance AI workstation showcasing LLM, LCM, and LAM paradigms....	13	Experimental	—	TypeScript
83	venantvr-web/vuejs.lighthouse.llm Dashboard Lighthouse augmenté par LLM : scoring, graphiques Chart.js, export...	13	Experimental	—	JavaScript
84	Ivanyinamyah321/remove-local-temu 🦊 Hide local sellers on Temu to view only products directly shipped by Temu...	13	Experimental	—	JavaScript
85	thijse/LLMJson Library to facilitate sharing json models with LLMs in C-sharp	12	Experimental	5	C#
86	john-mwangi/llm-browser Use an LLM to autonomously browse the Internet.	12	Experimental	2	Python
87	Divyanshu-karma/ShikshaManthan ShikshaManthan	11	Experimental	—	HTML
88	trnvll/oktavolt-core Playing around with LLMs, Langchain, NestJS, Turborepo. Inspired by New...	11	Experimental	3	TypeScript
89	m4k15y6666fk/llm-in-browser Using LLM with browser features.	11	Experimental	—	JavaScript
90	miguelangelo78/structura A new meta programming language for AI systems	11	Experimental	—	TypeScript
91	chenhunghan/lens-llm-extension Local, GPU powered LLM in Lens	11	Experimental	—	TypeScript
92	profiq/ai-web-explorer LLM-based web explorer for representing web apps as state machines.	10	Experimental	2	HTML

Comparisons in this category

web-llm and llm-x (73 vs 49) web-llm and llm.js (73 vs 46) localllm and llm-x (50 vs 49)