McWashr/pyscrapify
PyScrapify is a modular Python web scraper framework built on top of Selenium and BeautifulSoup. Easily extendable with new scrapers off of BaseScraper class. Avoid the bloat of creating web scrapers in Python!
This tool helps you gather specific information from websites by automating the extraction of data. You provide it with the web addresses you want to monitor and what data patterns to look for. It then outputs the extracted data, typically in a structured format like a CSV, making it useful for researchers, marketers, or anyone needing to collect data from public web pages.
No commits in the last 6 months.
Use this if you frequently need to collect structured data from specific public web pages and want a way to automate and manage these data extraction tasks efficiently.
Not ideal if you need to extract data from websites with highly inconsistent layouts, or if you're not comfortable with some technical configuration to define new data extraction rules.
Stars
11
Forks
5
Language
Python
License
MIT
Category
Last pushed
Feb 06, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/McWashr/pyscrapify"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.