trrahul/llama2.cs
Inference Llama 2 in one file of pure C#
This tool helps developers integrate Llama2-like large language model (LLM) inference directly into their .NET applications using pure C#. It takes a pre-trained model file (like `stories15M.bin`) and a tokenizer file as input to generate text based on an optional prompt. This is ideal for C# developers who need to embed simple, fast text generation capabilities into their projects without external dependencies.
102 stars. No commits in the last 6 months.
Use this if you are a C# developer looking for a straightforward, single-file implementation to run Llama2-style text generation within a .NET environment.
Not ideal if you need a full-featured LLM framework, want to train models, or are not working in a C#/.NET ecosystem.
Stars
102
Forks
14
Language
C#
License
MIT
Category
Last pushed
Feb 06, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/trrahul/llama2.cs"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.