hltcoe/sandle
Run a large language modeling SANDbox in your Local Environment
This tool helps developers and researchers run large language models on their own local machines, without relying on external cloud services. You provide your chosen large language model and get back a local web interface and an OpenAI-compatible API for interacting with it. It's designed for technical users who need to experiment with LLMs privately or with custom hardware.
No commits in the last 6 months.
Use this if you are a developer or researcher who wants to host and interact with large language models locally using your own hardware, either through a web interface or an API.
Not ideal if you are looking for a fully managed, production-ready LLM deployment solution or if you are not comfortable working with Docker and command-line interfaces.
Stars
7
Forks
1
Language
Python
License
—
Category
Last pushed
Oct 21, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/hltcoe/sandle"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
OpenCSGs/csghub-server
csghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and...
Whth/fabricatio
Fabricatio is a Python library designed for building applications that leverage Large Language...
OpenCSGs/csghub
CSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It...
Haidra-Org/horde-sdk
A python library to interact with AI-Horde's free generative AI APIs
Lightning-AI/litAI
LLM router + minimal agent framework in one. Call any LLM API with OpenAI format. Unified...