ndurner/mlx_chat
Gradio chat interface for FastMLX
This tool allows you to chat with large language models directly on your Apple Silicon device, without sending your data to external servers. You can upload plaintext files for the model to reference during your conversation, and then engage in a real-time, streaming chat. This is ideal for anyone who wants to use AI chat locally for personal or sensitive tasks.
No commits in the last 6 months.
Use this if you need to interact with AI chat models privately on your Apple computer, especially when working with sensitive information or personal notes.
Not ideal if you need access to the absolute latest, largest, or most complex AI models that require significant cloud computing resources.
Stars
12
Forks
—
Language
Python
License
MIT
Category
Last pushed
Sep 22, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ndurner/mlx_chat"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
yamadashy/repomix
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file....
kwaroran/Risuai
Make your own story. User-friendly software for LLM roleplaying
awaescher/OllamaSharp
The easiest way to use Ollama in .NET
mlc-ai/web-llm-chat
Chat with AI large language models running natively in your browser. Enjoy private, server-free,...
heshengtao/comfyui_LLM_party
LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and...