Go LLM Frameworks LLM Tools

Go language frameworks and libraries for building LLM-powered applications, agents, and orchestration systems. Does NOT include LLM provider SDKs, language-agnostic agent frameworks, or application-specific implementations in other languages.

There are 85 go llm frameworks tools tracked. 4 score above 50 (established tier). The highest-rated is cloudwego/eino at 62/100 with 10,009 stars. 3 of the top 10 are actively maintained.

Get all 85 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=go-llm-frameworks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	cloudwego/eino The ultimate LLM/AI application development framework in Go.	62	Established	10,009	Go
2	xyproto/algernon Small self-contained pure-Go web server with Lua, Teal, Markdown, Ollama,...	60	Established	2,993	Go
3	instill-ai/instill-core 🔮 Instill Core is a full-stack AI infrastructure tool for data, model and...	57	Established	2,307	Python
4	gocnn/candy Minimalist ML framework for Go.	53	Established	456	Go
5	Shuffle/Singul Singul: Connect to your favorite services with a Singul line of code.	49	Emerging	25	Go
6	voocel/litellm LiteLLM for Go, the easiest way to write LLM-based programs in Go	48	Emerging	31	Go
7	showntop/llmack The GoLang Fullstack LLM Framework(llm intergration、cache、route、rag、ai...	48	Emerging	17	Go
8	0x4D31/galah Galah: An LLM-powered web honeypot.	46	Emerging	638	Go
9	modfin/bellman Golang lib for LLM APIs, ChatGPT, Gemini and Anthropic	43	Emerging	67	Go
10	maximhq/maxim-go SDK to integrate Maxim in your Go app.	43	Emerging	7	Go
11	FrenchMajesty/consistent-classifier Go package for creating consistent labels for a large dataset from an...	40	Emerging	63	Go
12	plexusone/omnillm Multi-provider abstraction for LLMs including Anthropic, Bedrock, Gemini,...	40	Emerging	3	Go
13	turboline-ai/turbostream Analyze your realtime streaming data with LLM	38	Emerging	16	Go
14	tri2820/imply Open-source news site	38	Emerging	60	Go
15	bomfather/minefield Graphing SBOM's Fast.	38	Emerging	732	Go
16	gotoailab/llmhub A golang library that unify all the llm into one interface API	37	Emerging	50	Go
17	instill-ai/deprecated-model ⚗️ Instill Model contains components for AI model orchestration	37	Emerging	20	Makefile
18	svilupp/StreamCallbacks.jl Unified streaming interfaces for LLMs across various API providers. No more...	37	Emerging	2	Julia
19	instill-ai/deprecated-core 🔮 Instill Core contains components for supporting Instill VDP and Instill Model	36	Emerging	13	Makefile
20	natexcvi/go-llm A framework for building LLM based agents and integrating them into larger...	36	Emerging	158	Go
21	ahr-i/ai-artist An AI Artist application utilizing LLM and Stable Diffusion.	34	Emerging	4	Go
22	Daniel-Sogbey/llm_log_pipeline Containerized Go service that uses LLMs (e.g., LLaMA 3.1 Instruct) to...	32	Emerging	3	Go
23	primalmotion/simplai A Go toolbox for building powerful LLM based application	31	Emerging	3	Go
24	slashbase/layerengine Simple AI generated code running engine based on LLMs & Lua written in Golang	30	Emerging	1	Go
25	ssbuild/aigc_serving aigc_serving lightweight and efficient Language service model reasoning	29	Experimental	24	Python
26	ammarlodhi255/self-healing-LLM-pipeline This repo contains the code written primarily in Golang for a self-healing...	29	Experimental	1	Go
27	pardnchiu/cim-prototype LLM with Cognitive Imperfect Memory system	28	Experimental	6	Go
28	AmanPriyanshu/API-LLM-Hub A static-page vanilla-js interface for various LLM APIs (OpenAI, Claude,...	28	Experimental	8	HTML
29	konterfai-bot/konterfai Mirror repository for https://codeberg.org/konterfai/konterfai/ All...	28	Experimental	2	Go
30	chai2010/llmgo-book :books: Go和大语言模型编程	27	Experimental	44	Go
31	holysoles/bot-wrangler-traefik-plugin A Traefik Middleware Plugin that helps you wrangle those pesky LLM data...	27	Experimental	12	Go
32	turboline-ai/tsln-golang Time Series Lean Notation Implementation for Go lang	27	Experimental	6	Go
33	thiggle/api Structured LLM APIs	27	Experimental	156	MDX
34	morphy76/lang-actor lang-actor is a golang framework, based on the actor model, to build LLM applications	26	Experimental	1	Go
35	JoshPattman/jpf A Batteries-Included Framework to Build Scalable AI Apps	26	Experimental	1	Go
36	x2d7/interlude Stream-first LLM library for Go	26	Experimental	3	Go
37	petrgazarov/salami Infrastructure as Natural Language	24	Experimental	46	Go
38	mutablelogic/go-llama Go bindings for llama.cpp, an LLM inference engine	23	Experimental	2	Go
39	voluminor/openwebui-ollama-proxy A proxy server written entirely in Go (with no external dependencies) that...	23	Experimental	1	Go
40	joekariuki/sandgrouse Compress LLM API traffic for developers on metered connections.	23	Experimental	1	Go
41	pali-mem/pali Main Pali memory platform repository.	22	Experimental	1	Go
42	alparslanyilmaaz/llmstreamer Go library for building real-time AI chat applications with streaming responses	22	Experimental	3	Go
43	bds421/rho-llm-tutorial Progressive tutorials for the rho/llm Go library	22	Experimental	—	Go
44	hegner123/terse-tools Go library providing 18 builtin tools and provider adapters (Anthropic,...	22	Experimental	—	Go
45	bds421/rho-llm Multi-provider LLM client for Go. Streaming, tool use, extended thinking,...	22	Experimental	—	Go
46	zoobz-io/zyn Type-safe LLM orchestration for Go	22	Experimental	—	Go
47	zoobz-io/cogito LLM-powered reasoning chains with semantic memory for Go	22	Experimental	—	Go
48	mikyk10/phosphor AI image pipeline microservice — chain LLM calls, Lua scripts, and headless...	22	Experimental	—	Go
49	vasilisp/lingograph Minimalistic low-boilerplate framework for LLM pipelines	22	Experimental	1	Go
50	Babbili/go-llm-app using `gollm` to integrate Large Language Models into Go application and add...	22	Experimental	9	Go
51	dariubs/goAI A simple, modern, and reliable Go library for interacting with multiple LLM providers	22	Experimental	31	Go
52	chicogong/stream-relay-go A lightweight Go streaming relay for LLM/TTS APIs with production-grade...	21	Experimental	—	Go
53	uriel-flame-of-god/LOSS LLM Output Sanitization Specification	21	Experimental	—	Go
54	thecxx/openllm A lightweight Go library for connecting OpenAI, Claude, and Gemini with...	21	Experimental	—	Go
55	fixdot/llm-seeker Automatically discover OpenAI-compatible local LLM endpoints	21	Experimental	—	Go
56	gobenpark/gothought A lightweight, intuitive library for building LLM-powered applications in Go	21	Experimental	3	Go
57	flexigpt/llmtools-go LLM Tool implementations for Golang	21	Experimental	—	Go
58	cmitsakis/llm-api simple HTTP API for LLMs	20	Experimental	6	Go
59	Conceptual-Machines/grammar-school A multi-language framework for building tiny LLM-friendly DSLs	20	Experimental	1	Python
60	RamboRogers/cyberai WebUI for OpenAI, Ollama and Anthropic	20	Experimental	18	Go
61	hungpdn/llmgo LLM framework written in Go.	19	Experimental	—	Go
62	AdityaPatange1/llm-classifier-go A general-purpose LLM classifier written in Go. ✨	19	Experimental	3	Go
63	cckalen/intellichunk Go Based Lightweight RAG / LLM Tool with CLI + API	19	Experimental	14	Go
64	qcgm1978/Sabaki-llm 利用 KataGo 的专业围棋分析能力和 LLM 的自然语言理解与解释能力，为用户提供既专业又易于理解的围棋分析结果	18	Experimental	1	JavaScript
65	LLM-Tests-Checker/Common-Backend Monolith backend for LLM Tests Checker	18	Experimental	2	Go
66	FrenchMajesty/turbo-run A Go package to maximize throughput of API requests to LLM cloud providers.	17	Experimental	—	Go
67	aktagon/llmkit Go library providing a unified interface for LLM providers (OpenAI,...	17	Experimental	—	Go
68	course-go/delegato LLM Prompt Forwarding Service	17	Experimental	—	Go
69	joeychilson/websurfer An API designed to help LLMs surf the web.	17	Experimental	—	Go
70	JosemyDuarte/GoEvalsQAs Iterative LLM evaluation pipeline in Go example	17	Experimental	—	Go
71	mlziade/zllm A Golang/Fiber implementation of a LLM API running Ollama locally	17	Experimental	—	Go
72	carlRondoni/llm-agent-go Interference Gateway for a local LLM agent	17	Experimental	1	Go
73	mattjoyce/ductile Lightweight integration engine for small-scale automation.	15	Experimental	2	Go
74	llamacto/llama-go Llamabase is a modern Go framework powered by Gin, crafted for...	14	Experimental	1	Go
75	nchapman/lleme The easy way to find, run, and manage local LLMs.	14	Experimental	1	Go
76	donyaie/decision-llm-engine Production-ready Go service that turns unstructured decision questions into...	14	Experimental	1	Go
77	inercia/go-llm A simple, multi-provider LLM client library	14	Experimental	1	Go
78	Vitruves/llm-client A Go Tool to Infer from LLM servers	13	Experimental	—	Go
79	healeycodes/llmfs 🗂️ FUSE filesystem where file operations are handled by an LLM.	13	Experimental	7	Go
80	dwisiswant0/go-llms curated Go resources to provide comprehensive context to LLMs.	12	Experimental	3	—
81	Shell-Company/dumbdns an LLM client implemented in a DNS server using TXT queries for prompts	12	Experimental	6	Go
82	peterhellberg/llm Package llm implements a very small subset of the langchain project in Go.	12	Experimental	1	Go
83	vvxf/zhipuai_go The project is a Go application that interacts with a large language model...	11	Experimental	—	Go
84	HFrost0/nlcall 👾 Call golang function by nature language, a demonstration.	11	Experimental	—	Go
85	sjy-dv/GXpert A sample architecture that mimics MoE (Mixture of Experts) using Go.	11	Experimental	2	Go

Comparisons in this category

instill-core and deprecated-model (57 vs 37) instill-core and deprecated-core (57 vs 36) llmack and go-llm (48 vs 36) deprecated-model and deprecated-core (37 vs 36)