lkuffo/web-scraping
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
If you need to gather information from websites that don't offer a direct download or API, this project provides a collection of examples and code. It helps you take web page content and turn it into structured data you can use for analysis or other tasks. This is ideal for researchers, marketers, or data analysts who need to collect publicly available information from the internet.
388 stars.
Use this if you need to systematically collect data from websites, whether it's from a single page, across many pages, or from sites that load content dynamically.
Not ideal if you're looking for a no-code solution or if the data you need is already available via a public API or direct download from the website.
Stars
388
Forks
215
Language
Python
License
GPL-3.0
Category
Last pushed
Oct 20, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/lkuffo/web-scraping"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers....
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In...
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library.