jondot/awesome-rust-llm
🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI
This is a curated list of tools and resources for building applications that use Large Language Models (LLMs) like GPT, specifically for developers who prefer working with the Rust programming language. It collects frameworks, libraries, and utilities that help with tasks such as running LLM inference, chaining models for complex tasks, managing LLM memory, or integrating LLMs with other systems. The target audience is Rust developers looking to incorporate AI capabilities into their projects.
543 stars. No commits in the last 6 months.
Use this if you are a Rust developer looking for existing libraries and tools to build applications powered by Large Language Models or other AI models.
Not ideal if you are not a developer, or if you prefer to work with other programming languages like Python or JavaScript for AI development.
Stars
543
Forks
26
Language
—
License
—
Category
Last pushed
Mar 06, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/jondot/awesome-rust-llm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
trymirai/uzu
A high-performance inference engine for AI models
justrach/bhumi
⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed,...
lipish/llm-connector
LLM Connector - A unified interface for connecting to various Large Language Model providers
keyvank/femtoGPT
Pure Rust implementation of a minimal Generative Pretrained Transformer
ShelbyJenkins/llm_client
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from...