hyparam/hyllama
llama.cpp gguf file parser for javascript
This tool helps JavaScript developers integrate and manage large language models (LLMs) directly within their applications. It takes a GGUF model file, which contains all the necessary information to run an LLM, and efficiently extracts its metadata without needing to load the entire, often very large, file. Developers working on web or Node.js applications that use LLMs will find this useful for understanding model configurations.
No commits in the last 6 months. Available on npm.
Use this if you need to quickly access metadata from a GGUF file in a JavaScript environment for an LLM without downloading the entire model.
Not ideal if you are not a JavaScript developer or if you need to run the LLM itself rather than just parse its metadata.
Stars
50
Forks
3
Language
JavaScript
License
MIT
Category
Last pushed
Dec 11, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/hyparam/hyllama"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
microsoft/multilspy
multilspy is a lsp client library in Python intended to be used to build applications around...
mlc-ai/xgrammar
Fast, Flexible and Portable Structured Generation
vicentereig/dspy.rb
The Ruby framework for programming—rather than prompting—language models.
feenkcom/gt4llm
A GT package for working with LLMs
Evref-BL/Pharo-LLMAPI
Use LLM API from Pharo