gotzmann/llama.go
llama.go is like llama.cpp in pure Golang!
This project allows developers to run large language models (LLMs) like LLaMA directly on their personal computers or servers without needing expensive GPU clusters. It takes existing LLaMA model files as input and outputs text generations based on user prompts. Software developers and engineers who want to embed LLM capabilities into their Go applications or run local AI inference will find this useful.
1,398 stars. No commits in the last 6 months.
Use this if you are a developer looking to integrate large language models into Go applications or run local LLM inference on CPU-only machines efficiently.
Not ideal if you are looking for a plug-and-play, end-user application with a graphical interface, or if you primarily work with Python or other languages and don't require a Go-specific solution.
Stars
1,398
Forks
70
Language
Go
License
—
Category
Last pushed
Sep 20, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/gotzmann/llama.go"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.