soulteary/docker-yi-runtime
零一万物（34B）的本地运行环境。
This project provides a local environment to run the Yi 34B large language model from 01.AI (Kai-Fu Lee's venture). It allows users to input text or data for the model to process, generating various forms of AI-powered output such as text summaries, creative content, or analytical insights. It is designed for researchers, content creators, or data scientists who want to experiment with or integrate a powerful language model without relying on cloud services.
No commits in the last 6 months.
Use this if you need to run a large language model locally on your own machine for privacy, cost control, or custom integration purposes.
Not ideal if you prefer cloud-based AI services, require minimal setup, or lack the computational resources (like a powerful GPU) to run large models efficiently.
Stars
9
Forks
2
Language
Dockerfile
License
Apache-2.0
Category
Last pushed
Nov 26, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/soulteary/docker-yi-runtime"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from...
av/harbor
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
foldl/chatllm.cpp
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)