beatrizmilz/noticiasgov
Raspagem de dados de portais de noticias governamentais
This tool helps researchers, journalists, and policy analysts track public information by scraping news articles from Brazilian government portals. It takes the content of news websites as input and provides structured data in a downloadable .csv file, updated regularly. Anyone needing to analyze government communications or public sentiment will find this useful.
No commits in the last 6 months.
Use this if you need frequently updated, structured data on news published by Brazilian state government portals for research or analysis.
Not ideal if you need historical data from before the project started or real-time news alerts as new articles are published.
Stars
12
Forks
—
Language
R
License
GPL-3.0
Category
Last pushed
Mar 07, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/beatrizmilz/noticiasgov"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.