codingforentrepreneurs/Supercharged-Web-Scraping-with-Asyncio
Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka Selenium for Async).
This project helps developers efficiently gather information from many websites at once. You feed it a list of websites, and it quickly extracts the specific data you're interested in, such as product prices, news headlines, or contact details. It's designed for Python developers who need to automate large-scale data collection from the web.
No commits in the last 6 months.
Use this if you are a Python developer looking to build fast, scalable web scrapers for data collection or automation tasks.
Not ideal if you need a no-code solution or are not comfortable with Python and its development environment.
Stars
56
Forks
22
Language
Jupyter Notebook
License
—
Category
Last pushed
Apr 17, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/codingforentrepreneurs/Supercharged-Web-Scraping-with-Asyncio"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.