Adversing/hf-model-checker

A tool to analyze HuggingFace models and determine their compatibility with your system's resources.

/ 100

Emerging

This tool helps machine learning practitioners or hobbyists quickly figure out if a large language model from Hugging Face will run on their computer. You provide a Hugging Face model URL, and it tells you which version (quantization) of the model is best suited for your system's RAM and VRAM, ensuring you pick one that will actually perform well. It's for anyone downloading and running AI models locally.

No commits in the last 6 months.

Use this if you need to determine which specific version (quantization) of a Hugging Face model will run effectively on your local machine given its available memory (RAM and VRAM).

Not ideal if you are working with models that are not hosted on Hugging Face or if you are only interested in cloud-based model deployment.

large-language-models local-inference model-deployment machine-learning-operations resource-management

Stale 6m No Package No Dependents

Maintenance 0 / 25

Adoption 5 / 25

Maturity 16 / 25

Community 13 / 25

How are scores calculated?

Stars

Forks

Language

Python

License

MIT

Higher-rated alternatives

katanaml/table-query-model

Table Query with ML

michael-borck/loco-bench

Systematic benchmarks of quantized small language models on consumer hardware

Explore Transformer Models

All categories Trending Transformer directory Insights