LinkTime-Corp/llm-in-containers
Run LLM-related tools in containers.
This project helps developers and engineers easily package and deploy large language models (LLMs) and their associated tools. It provides examples and guides for taking LLM applications and preparing them to run consistently and scalably across different computing environments. The typical user is a software engineer or MLOps specialist looking to streamline LLM deployment.
No commits in the last 6 months.
Use this if you are a developer or MLOps engineer struggling to deploy large language models consistently and scalably across different environments.
Not ideal if you are looking for pre-built LLM applications or a no-code solution for using LLMs.
Stars
55
Forks
7
Language
Python
License
MIT
Category
Last pushed
Apr 12, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/LinkTime-Corp/llm-in-containers"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
b-data/jupyterlab-mojo-docker-stack
(GPU accelerated) Multi-arch (linux/amd64, linux/arm64/v8) JupyterLab MAX/Mojo docker images....
abundant-ai/oddish
Run Harbor tasks in the cloud
ivangabriele/docker-cuda-desktop
Ubuntu PyTorch CUDA Docker image with KDE Plasma Desktop & VNC. Ideal for LLM & Deep Learning...
b-data/mojo-docker-stack
(GPU accelerated) Multi-arch (linux/amd64, linux/arm64/v8) MAX/Mojo docker images. Please submit...
mysticrenji/ollama-on-kubernetes
An attempt to run ollama on kuberenetes