lwch/llama2.go
Port of Facebook's LLaMA 2 model in pure go and use little memory
This project helps developers and engineers integrate large language models (LLMs) like LLaMA 2 into their Go applications. It takes a LLaMA 2 model file as input and allows for text completion or chat interactions. The output is generated text based on the provided prompts, suitable for Go-based services or tools.
No commits in the last 6 months.
Use this if you are a Go developer looking to embed a LLaMA 2 model directly into your Go application for tasks like text generation or building conversational interfaces, especially when memory efficiency is a concern.
Not ideal if you are a non-developer seeking a ready-to-use application, or if you primarily work with other programming languages and don't require a Go-specific implementation.
Stars
36
Forks
1
Language
Go
License
MIT
Category
Last pushed
Mar 08, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/lwch/llama2.go"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.