Yukselcsgn/dynamic_web_scraper
A fully dynamic and extensible e-commerce scraping framework with automatic DOM adaptation, proxy rotation, and robust error handling.
This platform helps businesses, marketers, or analysts automatically gather product, pricing, and competitive information from e-commerce sites and other dynamic web sources. It takes URLs of target websites and delivers structured data, detailed price analyses, competitor comparisons, and visual reports directly to your dashboard or inbox. Retail strategists, market researchers, and competitive intelligence teams are the primary users.
Available on PyPI.
Use this if you need to continuously monitor product data, pricing, and deals across many websites, especially e-commerce, and require advanced analytics and automated reporting.
Not ideal if you only need to scrape a few static pages occasionally and don't require advanced anti-bot features, data analysis, or automated reporting.
Stars
7
Forks
2
Language
HTML
License
—
Category
Last pushed
Dec 15, 2025
Commits (30d)
0
Dependencies
15
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/Yukselcsgn/dynamic_web_scraper"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.