z7r1k3/creeper
Web Crawler and Scraper
Creeper helps you automatically gather information from websites and FTP sites. You provide it with a starting web address, and it explores links to find more pages, extracting data like text, emails, or phone numbers. This is ideal for anyone who needs to collect public information from many web pages efficiently, like researchers, marketers, or data analysts.
No commits in the last 6 months.
Use this if you need to systematically collect specific types of information, such as contact details or general text, from multiple web pages or FTP resources.
Not ideal if you need to interact with websites that require logins, solve CAPTCHAs, or have complex JavaScript-driven content.
Stars
12
Forks
1
Language
Python
License
GPL-3.0
Category
Last pushed
Jul 06, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/z7r1k3/creeper"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.