JuliaMerz/pantry
Actor based multi-llm registry + runner.
Pantry helps developers and researchers manage and run multiple large language models (LLMs) on their local machines. It allows you to download, configure, and operate various LLMs through a user interface or command-line. You input model files and configurations, and it outputs accessible LLM instances that can be integrated into your own applications or used directly.
No commits in the last 6 months.
Use this if you are a developer or researcher who needs to experiment with, compare, or integrate multiple local large language models into your projects without complex setup.
Not ideal if you primarily need to use a single LLM for basic chat interactions, or if you require an LLM to be simultaneously accessed by multiple parallel programs.
Stars
20
Forks
—
Language
Rust
License
Apache-2.0
Category
Last pushed
Sep 26, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/JuliaMerz/pantry"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
trymirai/uzu
A high-performance inference engine for AI models
justrach/bhumi
⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed,...
lipish/llm-connector
LLM Connector - A unified interface for connecting to various Large Language Model providers
keyvank/femtoGPT
Pure Rust implementation of a minimal Generative Pretrained Transformer
ShelbyJenkins/llm_client
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from...