chen0040/scrapy-projects
Projects using selenium, requests, bs4, and scrapy for web scraping on google images, google trends and others
This project helps you automatically collect images and trend data from websites like Google Images and Google Trends. You input search terms, and it provides organized image files and CSV data for your analysis. This is ideal for marketers, researchers, or data analysts who need to gather specific web data without manual clicking and saving.
No commits in the last 6 months.
Use this if you need to programmatically collect large sets of images or trend data from public web sources for your projects.
Not ideal if you need to scrape data from complex, authenticated websites or require a user-friendly interface instead of code-based operations.
Stars
10
Forks
2
Language
Python
License
MIT
Category
Last pushed
Apr 04, 2018
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/chen0040/scrapy-projects"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.