gfhe/LLM
私有化LLM 训练和部署探索
This project helps organizations set up and manage large language models (LLMs) privately, without relying on external cloud services. It provides all the necessary tools and environments to train new LLMs, deploy existing ones efficiently, and manage the transfer of models and datasets from public sources to secure, internal systems. It's designed for data scientists, machine learning engineers, and IT infrastructure managers who need to maintain strict control over their AI resources and data.
No commits in the last 6 months.
Use this if you need to develop, train, or deploy large language models within your own secure, isolated network, especially when dealing with sensitive data or specific compliance requirements.
Not ideal if you prefer using fully managed cloud-based LLM services or if your projects do not require on-premise infrastructure for model training and deployment.
Stars
8
Forks
—
Language
Shell
License
Apache-2.0
Category
Last pushed
Apr 30, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/gfhe/LLM"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
thu-pacman/chitu
High-performance inference framework for large language models, focusing on efficiency,...
sophgo/LLM-TPU
Run generative AI models in sophgo BM1684X/BM1688
NotPunchnox/rkllama
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning...
Deep-Spark/DeepSparkHub
DeepSparkHub selects hundreds of application algorithms and models, covering various fields of...
howard-hou/VisualRWKV
VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle...