KerfuffleV2/gguf-tools
Some random tools for working with the GGUF file format
This set of tools helps machine learning practitioners manage and inspect GGUF-formatted large language models. It takes GGUF model files as input and provides checksums for verification, allows combining metadata and tensor data into new GGUF files, or converts individual tensors into visual image representations for analysis. It's designed for individuals working with local or custom LLMs.
No commits in the last 6 months.
Use this if you need to verify the integrity of GGUF model files, create new models by combining existing metadata and tensor data, or visually inspect the internal structure of specific tensors within your LLMs.
Not ideal if you are looking for tools to train, quantize, or deploy GGUF models directly, as this focuses on inspection and manipulation rather than end-to-end model lifecycle management.
Stars
31
Forks
4
Language
Python
License
MIT
Category
Last pushed
Nov 24, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/KerfuffleV2/gguf-tools"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
microsoft/multilspy
multilspy is a lsp client library in Python intended to be used to build applications around...
mlc-ai/xgrammar
Fast, Flexible and Portable Structured Generation
vicentereig/dspy.rb
The Ruby framework for programming—rather than prompting—language models.
feenkcom/gt4llm
A GT package for working with LLMs
Evref-BL/Pharo-LLMAPI
Use LLM API from Pharo