Karthick-840/Crawl4ai-RAG-with-Local-LLM

A tool for scraping web documentation using Crawl4AI, converting it to Markdown, and preparing it for integration with local LLMs (like Ollama) to enhance their knowledge for learning and "vibe coding" workflows.

32
/ 100
Emerging

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 2 / 25
Adoption 4 / 25
Maturity 16 / 25
Community 10 / 25

How are scores calculated?

Stars

6

Forks

1

Language

Python

License

MIT

Category

web-to-markdown-rag

Last pushed

Jul 18, 2025

Commits (30d)

0

GitHub
Web-to-Markdown RAG · 99 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/rag/Karthick-840/Crawl4ai-RAG-with-Local-LLM"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

any4ai/AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts...

66

kreuzberg-dev/html-to-markdown

High performance and CommonMark compliant HTML to Markdown converter. Maintained by the...

64

ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

62

adbar/trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping,...

60

paulpierre/markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file...

53

Explore RAG Tools

All categories Trending RAG directory Insights