rabilrbl/llamafile-builder
A simple github actions script to build a llamafile and uploads to huggingface
This tool helps developers package large language models (LLMs) into a single, executable file called a 'llamafile'. You provide a URL to an existing LLM model file (specifically a GGUF file) and specify a Hugging Face repository. The process then creates the llamafile and uploads it to your designated repository, making it easier to distribute and run LLMs without complex setups.
No commits in the last 6 months.
Use this if you are a developer looking for a streamlined way to create and share single-file, portable LLMs from existing GGUF models.
Not ideal if you need to train or fine-tune an LLM, or if you are not comfortable working with GitHub Actions and Hugging Face repositories.
Stars
17
Forks
12
Language
Python
License
—
Category
Last pushed
Jan 11, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/rabilrbl/llamafile-builder"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.