gosom/scrapemate
Golang Crawling and scraping framework
This tool helps you gather information from websites by automatically navigating pages, clicking elements, and extracting data like product details, prices, or contact information. It takes a list of website URLs or patterns and produces structured data, such as a CSV file or a database record. Data analysts, marketers, or researchers who need to collect large amounts of public web data can use this.
196 stars.
Use this if you need to programmatically collect structured data from various websites, including those that use JavaScript to display content, and require robust error handling and proxy support.
Not ideal if you're looking for a no-code solution or a simple browser extension for occasional, manual data extraction.
Stars
196
Forks
24
Language
Go
License
MIT
Category
Last pushed
Jan 06, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/gosom/scrapemate"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.