datawizard1337/ARGUS
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
ARGUS is a user-friendly tool for automatically gathering information from many websites. You provide a list of website addresses, and it extracts details like text content or links between pages. The output is structured data that researchers, analysts, or marketers can use to study trends or gather insights from online information.
No commits in the last 6 months.
Use this if you need to efficiently collect text, links, and other data from a large number of diverse websites for research or analysis.
Not ideal if you primarily need to extract data from highly interactive web applications or if you require real-time, continuous monitoring of websites.
Stars
90
Forks
25
Language
Python
License
GPL-3.0
Category
Last pushed
Jan 13, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/datawizard1337/ARGUS"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.