acoyfellow/unsurf
Turn any website into a typed API
This tool helps you quickly extract the hidden data streams and interactions from any website, even complex web applications. It observes how a site works, then generates a structured 'map' of its internal APIs along with code to use them, allowing you to automate tasks that previously required manual browsing. It's designed for anyone needing to programmatically interact with websites, such as data analysts, researchers, or business automation specialists.
Available on npm.
Use this if you need to automate data collection or specific actions on a website but are blocked by a lack of official APIs or documentation.
Not ideal if you only need to scrape static content, as simpler tools might be more straightforward for that specific task.
Stars
7
Forks
2
Language
TypeScript
License
MIT
Category
Last pushed
Mar 30, 2026
Commits (30d)
0
Dependencies
6
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/acoyfellow/unsurf"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.