reader and just-scrape
These are competitors offering similar core functionality—both provide LLM-optimized web scraping with markdown output and crawling capabilities—though vakra-dev/reader is a self-hosted engine while ScrapeGraphAI/just-scrape is an API client wrapper, making them alternative architectural approaches to the same problem.
About reader
vakra-dev/reader
Open-source, production-grade web scraping engine built for LLMs. Scrape and crawl the entire web, clean markdown, ready for your agents.
This project helps developers gather clean, structured web content for AI models and agents. It takes website URLs or entire domains as input, intelligently navigates complex sites, bypasses common anti-bot measures, and outputs cleaned content in markdown or HTML. It's designed for developers building applications that need reliable, large-scale web data.
About just-scrape
ScrapeGraphAI/just-scrape
CLI for AI-powered web scraping, data extraction, search, and crawling powered by the ScrapeGraph AI API. Supports smart scraping, agentic browser automation, markdownify, sitemap discovery, and JSON mode for piping to AI agents.
This tool helps you quickly gather information from websites by intelligently extracting specific data or entire articles in a clean format. You provide a web address or a search query along with instructions for what to find, and it returns the desired information, optionally structured as data or plain text. It's designed for anyone who needs to collect data from the web for research, content analysis, or business intelligence.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work