danp/scraperlite
Scrape text and HTML based on CSS selectors and save contents to a SQLite database.
This tool helps you gather specific pieces of text or HTML from websites, like product descriptions or news headlines. You provide the website address and tell it what content to look for using CSS selectors, and it saves everything into a simple database. It's useful for anyone who needs to track changes on webpages over time, such as marketers monitoring competitor sites or researchers collecting data.
No commits in the last 6 months.
Use this if you need to regularly collect specific content from public websites and store it in an easily queryable database to track changes.
Not ideal if you need to interact with dynamic web elements, fill out forms, or scrape content from sites that require logins or complex navigation.
Stars
14
Forks
—
Language
Go
License
BSD-3-Clause
Category
Last pushed
Jan 26, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/danp/scraperlite"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.