graniet/rllm
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
This library helps developers integrate various large language models (LLMs) like OpenAI, Anthropic, or Google into their Rust applications. It takes your application's prompts and configurations as input and delivers responses from the chosen LLMs, often in a conversational or text completion format. Software engineers building LLM-powered features or applications will find this useful.
141 stars and 95 monthly downloads. No commits in the last 6 months.
Use this if you are a Rust developer needing to incorporate diverse LLM providers and complex prompting workflows into your projects with a unified interface.
Not ideal if you are not a Rust developer or if you only need to interact with a single LLM provider through its native SDK.
Stars
141
Forks
3
Language
Rust
License
—
Category
Last pushed
May 20, 2025
Monthly downloads
95
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/graniet/rllm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
promptslab/Promptify
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured...
masci/banks
LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and...
character-ai/prompt-poet
Streamlines and simplifies prompt design for both developers and non-technical users with a low...
promplate/partial-json-parser
Parse partial JSON generated by LLM
Hunyuan-PromptEnhancer/PromptEnhancer
PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions...