SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
This is a C#/.NET library for developers who want to integrate large language models (LLMs) like LLaMA and LLaVA directly into their applications. It allows you to take pre-trained LLM model files and run them efficiently on a local computer's CPU or GPU. The library provides the tools to build applications that can process text inputs and generate human-like text outputs, or even understand images in multimodal models.
3,572 stars. Actively maintained with 14 commits in the last 30 days.
Use this if you are a .NET developer building applications and want to embed powerful, locally-runnable AI language models into your software.
Not ideal if you are looking for a ready-to-use end-user application or don't have C#/.NET development experience.
Stars
3,572
Forks
488
Language
C#
License
MIT
Category
Last pushed
Mar 08, 2026
Commits (30d)
14
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/SciSharp/LLamaSharp"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Related models
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
kaito-project/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!