0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
This tool helps AI agents and users quickly get clean, structured content from any webpage, even if it usually blocks scraping or contains lots of irrelevant elements. You provide a URL, and it gives you a clean, summarized version of the main content, optimized for AI models or easy reading. This is ideal for researchers, marketers, or anyone who uses AI agents for web research.
161 stars.
Use this if you need to reliably extract concise, relevant information from websites for AI analysis, competitive research, or content aggregation without dealing with raw HTML or browser-based tools.
Not ideal if your primary need is to download entire websites with all their original styling and interactive elements intact for archiving or local browsing.
Stars
161
Forks
5
Language
Rust
License
MIT
Category
Last pushed
Mar 27, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mcp/0xMassi/webclaw"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
apify/apify-mcp-server
The Apify MCP server enables your AI agents to extract data from social media, search engines,...
brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public...
bartholomej/node-csfd-api
ČSFD API in JavaScript. Amazing NPM library for scrapping csfd.cz. Now with MCP server
ScrapeGraphAI/scrapegraph-mcp
ScapeGraph MCP Server
firecrawl/firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and...