nova-land/gbnf-compiler
Plug n Play GBNF Compiler for llama.cpp
This tool helps developers control the exact format of responses from large language models (LLMs) running on llama.cpp. You provide a template defining the desired structure, like "I choose {{tool}} because {{reason}}", and a grammar is generated. The LLM then outputs text adhering to this grammar, which can be parsed back into structured data like a dictionary. It's for developers building applications that need reliable, structured output from LLMs.
No commits in the last 6 months. Available on PyPI.
Use this if you need to ensure an LLM's free-form text output conforms to a specific, predefined structure, whether for extracting key information or guiding conversation flow.
Not ideal if you're looking for a user-friendly interface to build applications or if you don't require fine-grained control over LLM output grammar.
Stars
28
Forks
5
Language
Python
License
MIT
Category
Last pushed
Nov 08, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/nova-land/gbnf-compiler"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.