kurtosis-tech/llm-package
Spin up any(almost) llm locally!
This helps developers quickly set up and experiment with large language models and a chatbot UI locally, without needing to configure complex infrastructure. It takes simple commands to specify the desired AI model, and outputs a running environment with an API endpoint and an optional chat interface. AI application developers or researchers can use this to test and integrate various models.
No commits in the last 6 months.
Use this if you are an AI developer who needs to rapidly spin up and test different large language models locally for your applications, with or without a chat interface.
Not ideal if you are an end-user looking for a pre-built, production-ready AI application or a simple consumer-facing chat interface.
Stars
14
Forks
—
Language
Starlark
License
MIT
Category
Last pushed
Dec 04, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/kurtosis-tech/llm-package"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
mozilla-ai/any-llm
Communicate with an LLM provider using a single interface
Maximilian-Winter/llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models...
CliDyn/climsight
A next-generation climate information system that uses large language models (LLMs) alongside...
ShishirPatil/gorilla
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
OoriData/OgbujiPT
Client-side toolkit for using large language models, including where self-hosted