slb350/open-agent-sdk-rust
Rust SDK for building AI agents with local OpenAI-compatible servers (LMStudio, Ollama, llama.cpp, vLLM). Features streaming, tools, hooks, retry logic, and comprehensive examples.
This is a software development kit (SDK) that helps developers create custom AI assistants, like copy editors, market analyzers, or code reviewers. It takes instructions and your local AI model, producing intelligent text or actions. The target user is a software developer building AI-powered applications or agents who wants to run them privately on their own hardware.
Use this if you are a developer looking to build high-performance AI agents in Rust that run privately using local, OpenAI-compatible AI models like those from LM Studio or Ollama.
Not ideal if you want to use cloud-based AI models like OpenAI's ChatGPT or Anthropic's Claude directly, or if you are not a Rust developer.
Stars
13
Forks
2
Language
Rust
License
MIT
Category
Last pushed
Nov 17, 2025
Monthly downloads
50
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/slb350/open-agent-sdk-rust"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
0xPlaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
Abraxas-365/langchain-rust
🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
moly-ai/moly-ai
Moly AI: A local + cloud AI LLM multi-platform GUI app in pure Rust
ivangabriele/mistralai-client-rs
Rust client for Mistral AI API.
edgee-ai/rust-sdk
The official Rust library for the Edgee AI Gateway