ahoylabs/gguf.js
A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
When working with large language model files in the GGUF format, this tool helps you quickly understand their characteristics without loading the entire file. It takes a GGUF file as input and outputs key information like the model's architecture or context length. This is useful for developers building applications that need to inspect or manage various local AI models.
No commits in the last 6 months.
Use this if you are a JavaScript/TypeScript developer who needs to programmatically read and validate the metadata of GGUF-formatted AI models.
Not ideal if you are a non-developer or if you need to load and run the actual AI model for inference, rather than just inspect its metadata.
Stars
51
Forks
1
Language
TypeScript
License
MIT
Category
Last pushed
Jul 30, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ahoylabs/gguf.js"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
trymirai/uzu
A high-performance inference engine for AI models
justrach/bhumi
⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed,...
lipish/llm-connector
LLM Connector - A unified interface for connecting to various Large Language Model providers
keyvank/femtoGPT
Pure Rust implementation of a minimal Generative Pretrained Transformer
ShelbyJenkins/llm_client
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from...