memvid/maw
Crawl any website into a single searchable file. Query it forever, offline.
This tool helps you gather information from any website, blog, or even your own code repository into a single, searchable file. You input a URL or local path, and it produces a compact file you can instantly search or ask questions of, even offline. It's ideal for developers, researchers, technical writers, or anyone who frequently references online documentation or articles.
Available on npm.
Use this if you need to create a permanent, offline-accessible archive of web content like documentation, blogs, or codebases, and want to quickly search or get AI-powered answers from it without relying on browser tabs or external search engines.
Not ideal if you only need to look up a single piece of information once or don't require offline access and advanced search capabilities.
Stars
27
Forks
4
Language
TypeScript
License
—
Category
Last pushed
Jan 19, 2026
Commits (30d)
0
Dependencies
10
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/memvid/maw"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
vakra-dev/reader
Open-source, production-grade web scraping engine built for LLMs. Scrape and crawl the entire...
joaobenedetmachado/scrapit
A (really) easy way to web scrape
firecrawl/open-scouts
🔥 AI-powered web monitoring platform. Create automated scouts that search the web and send email...
BrowserCash/teracrawl
High-performance web crawler API optimized for LLMs. Turn any search or website into clean...
poneoneo/Alibaba-CLI-Scraper
Create your own Alibaba dataset and interact with it in plain English.