teticio/lambda-selenium
Use AWS Lambda functions as a proxy pool to scrape web pages with Selenium.
This tool helps you gather information from many websites by automating web browsers like Chrome, making it seem like your requests are coming from many different computers. It takes your instructions for browsing the web and returns the content or data you've asked for. This is for professionals who need to collect data from many different websites without being blocked, like market researchers, competitive intelligence analysts, or data scientists.
No commits in the last 6 months.
Use this if you need to gather large amounts of data from numerous websites using automated browser actions (like clicking buttons or filling forms) and need to avoid being detected or blocked by target sites.
Not ideal if you only need to scrape a few pages, prefer a simple API for web data, or don't have experience setting up cloud infrastructure.
Stars
11
Forks
—
Language
Python
License
BSD-3-Clause
Category
Last pushed
Feb 02, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/teticio/lambda-selenium"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.