crawlbase/crawlbase-python
Fast python library for the Crawlbase API
This is a Python library that helps developers access the Crawlbase web scraping and data extraction services. It takes URLs and optional parameters as input, returning raw webpage content, structured data (like product details or email leads), screenshots, or stored data. This tool is for developers building applications that need to collect information from websites at scale, such as for data analysis, market research, or content aggregation.
No commits in the last 6 months.
Use this if you are a developer building a Python application that needs to programmatically fetch web pages, extract specific data fields, find email leads, capture website screenshots, or manage previously scraped data.
Not ideal if you need a no-code solution for web scraping or if your project doesn't involve Python development.
Stars
25
Forks
2
Language
Python
License
Apache-2.0
Category
Last pushed
Feb 25, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/crawlbase/crawlbase-python"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.