Kagamma/llama-pas
Free Pascal bindings for llama.cpp
This project helps Free Pascal developers integrate powerful large language model capabilities directly into their applications. You can input text prompts and receive generated text, enabling features like chatbots, content creation, or intelligent assistants within your Free Pascal software. It's designed for Free Pascal programmers who want to leverage LLaMA models efficiently on standard CPUs.
No commits in the last 6 months.
Use this if you are a Free Pascal developer looking to add fast, CPU-based large language model inference to your applications without needing specialized hardware.
Not ideal if you are not a Free Pascal developer or if you require GPU-accelerated inference for extremely high throughput or larger, more complex models.
Stars
23
Forks
6
Language
Pascal
License
MIT
Category
Last pushed
Apr 22, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/Kagamma/llama-pas"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.