xtekky/gpt4local
Openai-style, fast & lightweight local language model inference w/ documents
This project helps individual developers or small teams integrate powerful language models directly into their applications or workflows without relying on external services. You input text prompts or documents, and it outputs human-like text responses or extracted information, all processed locally on your own machine. It's designed for developers building applications that need on-device AI capabilities.
140 stars. No commits in the last 6 months.
Use this if you are a developer looking to embed local language model inference with document interaction directly into your Python applications for privacy, cost control, or offline access.
Not ideal if you are an end-user without programming experience, as this project requires coding in Python to set up and use.
Stars
140
Forks
32
Language
Python
License
—
Category
Last pushed
Mar 19, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/xtekky/gpt4local"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Chainlit/chainlit
Build Conversational AI in minutes ⚡️
FullStackWithLawrence/aws-openai
Example ChatGPT chatbots using Langchain and OpenAI
mfmezger/conversational-agent-langchain
FastAPI Backend for a Conversational Agent using Cohere, (Azure) OpenAI, Langchain & Langgraph...
kvncampos/nautobot-ai-ops
Nautobot AI Plugin - Large Language Models (LLM), Model Context Protocol (MCP), Middleware and...
haseeb-heaven/langchain-coder
Web Application that can generate code and fix bugs and run using various LLM's (GPT,Gemini,PALM)