rafska/awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

63
/ 100
Established

This is a curated collection of resources for running large language models (LLMs) on your own computer or local infrastructure. It provides access to various platforms, tools, and models that allow you to process natural language input and generate text, code, or even images and audio locally. This resource is for developers, researchers, and hobbyists who want to leverage LLMs without relying on external cloud services.

1,317 stars. Actively maintained with 23 commits in the last 30 days.

Use this if you are a developer, researcher, or enthusiast looking for comprehensive resources to run and experiment with large language models directly on your local machine or private servers.

Not ideal if you are an end-user seeking a simple, out-of-the-box application for general LLM use without any technical setup.

local LLM deployment AI model inference machine learning engineering open-source AI language model development
No Package No Dependents
Maintenance 20 / 25
Adoption 10 / 25
Maturity 15 / 25
Community 18 / 25

How are scores calculated?

Stars

1,317

Forks

115

Language

License

MIT

Last pushed

Mar 10, 2026

Commits (30d)

23

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/rafska/awesome-local-llm"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.