Orfeous/llamacpp.net
C#/.NET binding of llama.cpp
This project helps .NET developers integrate large language models (LLMs) into their applications. It takes raw LLM files and provides a straightforward C# interface for developers to use, avoiding the complexities of C++ pointers and memory management. It's designed for C# and .NET developers who want to build applications leveraging local LLMs.
No commits in the last 6 months.
Use this if you are a .NET developer building an application and need to easily incorporate local large language models without dealing with low-level C++ details.
Not ideal if you are not a .NET developer or are looking for a cloud-based LLM solution rather than local execution.
Stars
14
Forks
1
Language
C#
License
Apache-2.0
Category
Last pushed
Oct 23, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/Orfeous/llamacpp.net"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
mishushakov/llm-scraper
Turn any webpage into structured data using LLMs
Mobile-Artificial-Intelligence/maid
Maid is a free and open source application for interfacing with llama.cpp models locally, and...
run-llama/LlamaIndexTS
Data framework for your LLM applications. Focus on server side solution
JHubi1/ollama-app
A modern and easy-to-use client for Ollama
serge-chat/serge
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.