guywaldman/orch
Rust framework for LLM orchestration
This is a Rust library for developers building applications that use large language models (LLMs). It helps integrate LLMs like Ollama into Rust projects to generate text, stream responses, create structured data, or produce embeddings from text inputs. Developers can use this to add AI capabilities to their Rust-based software.
203 stars and 27 monthly downloads. No commits in the last 6 months.
Use this if you are a Rust developer looking to build applications that leverage large language models for various tasks.
Not ideal if you are not a Rust programmer or are looking for a ready-to-use LLM application rather than a development framework.
Stars
203
Forks
4
Language
Rust
License
MIT
Category
Last pushed
Jul 27, 2024
Monthly downloads
27
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/guywaldman/orch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
0xPlaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
Abraxas-365/langchain-rust
🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
moly-ai/moly-ai
Moly AI: A local + cloud AI LLM multi-platform GUI app in pure Rust
ivangabriele/mistralai-client-rs
Rust client for Mistral AI API.
edgee-ai/rust-sdk
The official Rust library for the Edgee AI Gateway