imartinezl/newspaper-scraping
Open & free access to subscription-based regional newspaper through RSS + article scraping 📰📎
This project helps you access local news from specific regional newspapers, even if they're behind a paywall. It takes in RSS feeds from subscription-based news sites and outputs a simple, free webpage displaying the full articles (title, subtitle, image, and text). It's designed for individuals who want to stay informed about local matters without paying for multiple regional newspaper subscriptions.
Use this if you are a local resident wanting free access to specific regional news that is otherwise paywalled.
Not ideal if you need comprehensive news aggregation from many sources or want to track national or international news.
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/imartinezl/newspaper-scraping"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.