IBMDeveloperUK/Golang-Web-Scraping
Learn how to scrape web content from HTML and see how web scraping differs to web crawling
This project teaches software developers how to extract specific information from web pages using Go. It takes a web page's HTML as input and outputs structured data, helping developers build applications that collect information from websites. This is for developers interested in programmatic data extraction from the web.
No commits in the last 6 months.
Use this if you are a developer looking to learn the fundamentals of web scraping with Go.
Not ideal if you are looking for a ready-to-use web scraping tool without writing code, or if you are not a Go developer.
Stars
11
Forks
19
Language
Go
License
Apache-2.0
Category
Last pushed
Aug 14, 2020
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/IBMDeveloperUK/Golang-Web-Scraping"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.