sasha0552/ToriLinux
Linux LiveCD for offline AI training and inference.
This project provides a ready-to-use operating system that boots from a USB drive, allowing you to train or run AI models like Large Language Models (LLMs) and Stable Diffusion completely offline. It comes pre-loaded with popular AI tools, so you can quickly get started without complex installations. This is ideal for AI practitioners, researchers, or enthusiasts who need a portable, self-contained environment for local AI tasks.
No commits in the last 6 months.
Use this if you need an isolated, pre-configured environment to run or train AI models like LLMs and Stable Diffusion on your own hardware, without needing an internet connection for setup or operation.
Not ideal if you prefer to set up and manage individual AI development tools yourself on an existing operating system, or if you primarily work with cloud-based AI services.
Stars
19
Forks
4
Language
Jinja
License
MIT
Category
Last pushed
Dec 28, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/sasha0552/ToriLinux"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from...
av/harbor
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
foldl/chatllm.cpp
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)