zytedata/zyte-smartproxy-headless-proxy
A complimentary proxy to help to use SPM with headless browsers
This tool helps web scrapers using headless browsers like Chrome, Firefox, Splash, Selenium, or Puppeteer to seamlessly integrate with Zyte Smart Proxy Manager (formerly Crawlera). It takes your requests, automatically handles authentication, injects necessary headers, and manages sessions so you don't have to deal with complex browser configurations. It's for data professionals who need to reliably collect data from websites using advanced proxy services.
107 stars. No commits in the last 6 months.
Use this if you are performing web scraping with headless browsers and need a straightforward way to use Zyte Smart Proxy Manager without intricate browser setup for proxy authentication or custom headers.
Not ideal if you are not using Zyte Smart Proxy Manager or if your web scraping solution does not involve headless browsers or tools like Selenium/Puppeteer.
Stars
107
Forks
38
Language
Go
License
MIT
Category
Last pushed
May 29, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/zytedata/zyte-smartproxy-headless-proxy"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.