Jkanon/webmagician-ui
An admin UI project for a configurable web crawler platform
This is a user interface for managing a web scraping platform. It allows you to configure and oversee web crawlers, defining what information to extract from websites. You input scraping rules and get structured data or content from various web sources. This tool is for web administrators or data managers who need to extract and manage large amounts of data from the internet.
No commits in the last 6 months.
Use this if you need a visual interface to control and configure web crawlers for data extraction tasks.
Not ideal if you are looking for the web crawling engine itself, as this is solely the administrative interface.
Stars
42
Forks
14
Language
TypeScript
License
MIT
Category
Last pushed
Oct 27, 2019
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/Jkanon/webmagician-ui"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.