Ruby LLM Frameworks LLM Tools

Frameworks and libraries for building LLM-powered applications in Ruby, including agents, chat interfaces, and AI-driven features. Does NOT include language ports, grammar specifications, or non-Ruby implementations.

There are 37 ruby llm frameworks tools tracked. 1 score above 70 (verified tier). The highest-rated is microsoft/multilspy at 78/100 with 548 stars. 2 of the top 10 are actively maintained.

Get all 37 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=ruby-llm-frameworks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	microsoft/multilspy multilspy is a lsp client library in Python intended to be used to build...	78	Verified	548	Python
2	mlc-ai/xgrammar Fast, Flexible and Portable Structured Generation	62	Established	1,581	C++
3	vicentereig/dspy.rb The Ruby framework for programming—rather than prompting—language models.	48	Emerging	208	Ruby
4	feenkcom/gt4llm A GT package for working with LLMs	47	Emerging	16	Smalltalk
5	Evref-BL/Pharo-LLMAPI Use LLM API from Pharo	45	Emerging	7	Smalltalk
6	antononcube/Raku-LLM-Functions Raku package for functions and function objects to access, interact, and...	43	Emerging	5	Raku
7	llmrb/llm.rb Ruby toolkit for multiple Large Language Models (LLMs)	42	Emerging	106	Ruby
8	scientist-labs/ruby_llm-red_candle Support for local LLMs, running inside of your Ruby process for RubyLLM	41	Emerging	4	Ruby
9	trymirai/uzu-swift A high-performance inference engine for AI models	40	Emerging	52	Swift
10	hyparam/hyllama llama.cpp gguf file parser for javascript	40	Emerging	50	JavaScript
11	janeapp/riffer The all-in-one Ruby framework for building AI-powered applications and agents.	37	Emerging	6	Ruby
12	trymirai/uzu-ts A high-performance inference engine for AI models	37	Emerging	8	TypeScript
13	xybrid-ai/xybrid Run LLMs, ASR and TTS locally in your app (Rust core, iOS/Android/Flutter/Unity)	36	Emerging	57	Rust
14	KerfuffleV2/gguf-tools Some random tools for working with the GGUF file format	34	Emerging	31	Python
15	miko-ai-org/llmbatching An openAI / LLM API wrapper that simplifies the batching API to reduce costs by 50%	31	Emerging	19	TypeScript
16	sanjaybip/llm-clients A list of LLM clients that can be used to interact with a proprietary or...	30	Emerging	11	—
17	antononcube/Raku-DSL-Examples Raku data package with examples of DSL commands translations to programming...	29	Experimental	3	Raku
18	moeki0/baran Text Splitter for Large Language Model (LLM) datasets.	29	Experimental	19	Ruby
19	mensfeld/pocketrb Pocket-sized Ruby AI agent framework / LLM assistant with multi-LLM support	28	Experimental	36	Ruby
20	AlbanPerli/pygbnf A composable Python DSL for building GBNF grammars compatible with llama.cpp.	27	Experimental	4	Python
21	gbaptista/mistral-ai A Ruby gem for interacting with Mistral AI's large language models.	27	Experimental	30	Ruby
22	mariochavez/llm_server Rack API application for Llama.cpp	26	Experimental	39	Ruby
23	nicieja/lammy An LLM library for Ruby	25	Experimental	39	Ruby
24	crmne/ruby_llm-workshop Companion code for the "Building AI-Powered Apps with RubyLLM" workshop	25	Experimental	5	HTML
25	temphia/fuzzylogic LLM + temphia	23	Experimental	3	Go
26	antononcube/WL-DSLExamples-paclet Wolfram Language paclet with Domain Specific Language (DSL) examples...	23	Experimental	—	Wolfram Language
27	LegionIO/legion-llm LLM integration for LegionIO - chat, embeddings, tool use, and agents via ruby_llm	22	Experimental	—	Ruby
28	hiremav/spectre Spectre is a Ruby gem that makes it easy to AI-enable your Ruby on Rails application.	21	Experimental	28	Ruby
29	e-kayrakli/llm.chpl A Chapel port of llm.c	20	Experimental	6	Chapel
30	IohannesArnold/xml_gbnf A GBNF grammar of XML for use in llama.cpp	20	Experimental	6	—
31	mariochavez/llm_client Ruby client to connect to LLM Server.	19	Experimental	4	Ruby
32	antononcube/Raku-ML-FindTextualAnswer Raku package for finding sub-strings in a given text that appear to answer...	19	Experimental	—	Raku
33	jd174/InfraLLM InfraLLM is an framework to allow LLMs to (somewhat) safely interact with SSH clients	18	Experimental	2	C#
34	vicentereig/a2ui-rails A2UI for Rails - LLM-driven UI generation with DSPy.rb and Turbo Streams	16	Experimental	13	Ruby
35	redBorder/redborder-llm Main package for redborder-ng LLM assistant.	11	Experimental	—	Ruby
36	antononcube/Raku-WWW-MistralAI Raku package for accessing LLM models and functionalities of MistralAI.	11	Experimental	—	Raku
37	greyman888/burgers A practical use of Ai Struct to implement the principles of Natural Language Design	10	Experimental	2	Ruby

Comparisons in this category

llm.rb and pocketrb (42 vs 28)