spekulatius/awesome-php-scrapers-and-crawlers
An awesome list covering PHP scrapers, spiders and crawlers
This list compiles open-source tools for gathering information from websites, whether you need to extract specific data points or follow links to map an entire site. It helps developers who use PHP to build custom solutions for web data extraction. You provide the target websites, and the tools help you programmatically collect and structure the desired information.
No commits in the last 6 months.
Use this if you are a PHP developer looking for existing libraries to build custom web scraping or crawling applications.
Not ideal if you need an off-the-shelf, no-code solution for web data extraction or if your primary development language is not PHP.
Stars
15
Forks
1
Language
—
License
—
Category
Last pushed
May 30, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/spekulatius/awesome-php-scrapers-and-crawlers"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.