jasonacox/TinyLLM
Setup and run a local LLM and Chatbot using consumer grade hardware.
This project helps you set up and run a large language model (LLM) and a ChatGPT-like chatbot interface right on your own computer, using typical consumer hardware like a gaming PC. You feed it questions or URLs, and it provides text answers, summaries, news headlines, or stock information. Anyone who wants to experiment with or use LLMs privately without relying on external cloud services would find this useful.
319 stars.
Use this if you want to run a powerful AI chatbot locally on your own desktop or laptop computer, with capabilities like summarizing web pages or getting current news.
Not ideal if you need an LLM solution for high-volume, multi-user applications or enterprise-grade performance, as it's optimized for single-user consumer hardware.
Stars
319
Forks
37
Language
JavaScript
License
MIT
Category
Last pushed
Nov 23, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/jasonacox/TinyLLM"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Mintplex-Labs/anythingllm-docs
Documentation of AnythingLLM by Mintplex Labs Inc.
undreamai/LLMUnity
Create characters in Unity with LLMs!
bloodworks-io/phlox
Open source, local first AI medical scribe for desktop and web.
snexus/llm-search
Querying local documents, powered by LLM
mamei16/LLM_Web_search
An extension for oobabooga/text-generation-webui that enables the LLM to search the web