jeromeboivin/ollama-chat
A single file, customizable Python CLI tool for interacting with local Language Models, ensuring data privacy while providing conversation memory and extensibility through plugins and efficient Retrieval-Augmented Generation capabilities with ChromaDB integration. Also compatible with OpenAI API.
This tool helps individuals and teams interact with large language models for various tasks, ensuring your data remains private and secure on your own computer. You provide documents, web searches, or direct questions, and it delivers enhanced, context-rich answers, summaries, or creative ideas. It's designed for anyone who needs to leverage AI for research, content generation, or problem-solving without sharing sensitive information externally.
Use this if you need a flexible, private AI assistant that can summarize documents, brainstorm ideas, answer questions, or conduct web research using large language models, all while keeping your data local.
Not ideal if you prefer using cloud-based AI services without any local setup or if your primary need is for a simple, out-of-the-box chat interface without customization or RAG capabilities.
Stars
18
Forks
5
Language
Python
License
—
Category
Last pushed
Feb 18, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/jeromeboivin/ollama-chat"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Mintplex-Labs/anythingllm-docs
Documentation of AnythingLLM by Mintplex Labs Inc.
undreamai/LLMUnity
Create characters in Unity with LLMs!
bloodworks-io/phlox
Open source, local first AI medical scribe for desktop and web.
snexus/llm-search
Querying local documents, powered by LLM
mamei16/LLM_Web_search
An extension for oobabooga/text-generation-webui that enables the LLM to search the web