jroakes/CrawlnChat
A modular web crawling and chat system that allows for ingesting website content through XML sitemaps, converting to vector embeddings, and providing AI-powered chat interfaces through multiple frontend options.
This project helps businesses and organizations create an AI-powered chatbot that can answer questions using the information directly from their own websites. It takes public website content (specified by an XML sitemap) and transforms it into a searchable knowledge base, allowing the chatbot to provide accurate, up-to-date answers. Anyone responsible for customer support, internal documentation, or public information dissemination can use this to automate responses.
No commits in the last 6 months.
Use this if you need a reliable chatbot that pulls answers directly from your public website content and ensures responses adhere to your brand guidelines.
Not ideal if your primary knowledge base is not web-based (e.g., internal documents, databases) or if you require a chatbot that can perform actions beyond answering questions.
Stars
27
Forks
—
Language
Python
License
MIT
Category
Last pushed
May 13, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/jroakes/CrawlnChat"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Azure-Samples/azure-openai-rag-workshop
Create your own ChatGPT with Retrieval-Augmented-Generation workshop
chatchat-space/Langchain-Chatchat
Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用...
avrabyt/RAG-Chatbot
RAG enabled Chatbots using LangChain and Databutton
byu-cpe/Maeser
A package for building RAG chatbot applications for educational contexts.
Storia-AI/sage
Chat with any codebase in under two minutes | Fully local or via third-party APIs