antirez/gguf-tools
GGUF implementation in C as a library and a tools CLI program
This tool helps machine learning engineers and researchers understand and compare GGUF model files. You input one or more GGUF files, and it outputs detailed information about their internal structure, including key-value pairs, tensor details, and even a comparison of tensor weights between two models. This is ideal for those who work with local large language models and need to inspect or verify their GGUF assets.
311 stars. No commits in the last 6 months.
Use this if you need to deeply inspect the contents of GGUF model files, compare the underlying weights of different models, or debug quantization issues.
Not ideal if you are looking to train, run, or merge GGUF models, as its primary purpose is inspection and analysis, not model deployment or modification (beyond specific experimental features like 'split-mixtral').
Stars
311
Forks
22
Language
C
License
MIT
Category
Last pushed
Aug 28, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/antirez/gguf-tools"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
trymirai/uzu
A high-performance inference engine for AI models
justrach/bhumi
⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed,...
lipish/llm-connector
LLM Connector - A unified interface for connecting to various Large Language Model providers
keyvank/femtoGPT
Pure Rust implementation of a minimal Generative Pretrained Transformer
ShelbyJenkins/llm_client
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from...